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Preface 


Tlic applic.ilion of empirical research methods to education goes back 
little more than half a eenturs-. Since then, the schools have been called 
upon to fulfill roles and obligations largely unconccivcd of by nineteenth 
century educators. Unfortunately, it has not always been possible to justify 
modem educational practices or innovations. Like his predecessor, today’s 
educator is often forced into making decisions without knowledge derived 
from empirical research findings to guide him or to help justify his actions. 

Current knowledge about education has come from many sources, rang- 
ing in validity from the biased pronouncements of the grossly misinformed 
to highly dependable statements originating with those who have gone to 
the trouble to test their e.xpectations empirically. Research methods are 
devised to provide investigators with the techniques, procedures, and knowl- 
edge needed to verify or reject these expectations, not with the hope of 
“proving” one’s own point or in finding fault with others’, but to study 
problems within a scientific framework that encourages the resolution 
of problems by rational and empirical means. 

This text is designed to provide readers with the empirical foundations 
of educational research. It is deliberately not a textbook in statistics, 
measurements, or historical methodology, although all of these areas are, 
of course, related to empirical research methods. 

I am convinced that to try to explain research design to students who 
have not had at least an introductory course in statistics is to do them a 
great disservice. They are likely, in a one-semester course in research 
methods, to learn neither statistics nor research design and to dislike both. 
Unless graduate students in education are given training in statistics and 
research design, we are contributing to the unhappy precedence of prepar- 
ing students who are unable to read professional journals or evaluate their 
own practices. Education will not be regarded as a profession until its 
practitioners have mastered these foundational skills. 

Nor does this text pretend to cover historical or philosophical research 
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methods. Historiography is in itself a highly complex field deserving to be 
studied on its own by those planning to specialize in the history or philos- 
ophy of education. The few pages on historical research methods typically 
included in texts on research docs justice neither to history nor to 
empiricism. 

This text has the following purposes: 

1. To acquaint graduate students in education with the potentials and 
limitations of empirical research; 

2. To provide students with an understanding of the contributions that 
empirical research methods have made to educational practices; 

3. To show the relationships between empiricism and the philosophical 
and theoretical assumptions underlying empirical research pro- 
cedures; 

4. To describe the tools and methods used in empirical investigations. 

To accomplish these objectives, this text has incorporated a number of 
special features; 

1. Chapters arc arranged sequentially, taking the student from the 
point of selecting a research project to the analysis and presentation 
of his findings; 

2. Considerations related to the writing of a research report are included 
throughout the text and not in a separate section or appendix. The 
research report is a formal way of communicating scientific informa- 
tion, and as such, its contents should reflect these understandings. 
By keeping related elements together, these relationships can be most 
easily seen; 

3. A rather detailed summary is provided at the end of each chapter. 
This can serve two purposes: to introduce the student to the con- 
tents of the chapter and to help him to review its contents; 

4. Every chapter contains an annotated bibliography. It is provided to 
take the curious reader into greater depth than can be presented in 
this text; 

5. Practice exercises accompany each chapter. Some exercises can 
easily be converted to objectively scored examinations; others are 
designed as projects or for class discussion. Difficulty levels range 
widely. The majority of the exercises are designed to test how well 
the student can apply and understand the concepts he has read about; 

6. The text is specifically designed for master’s degree candidates in 
education, although it may also be used with more advanced students 
if the supplementary readings are used extensively; 

7. The assumption is made that the student has taken and understands 
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bafic clcmcn'is of dcscnpiivc and snniplinr stati'^lics. If assiimp- 
lion cannot be met. it i' suprc<-tcd that tlic instructor cover these 
topics as early in the semester as p<''ssihlc; 

8. Tile tc\t !>■ suitable for cither a one-semester or year course in re- 
search methods. For a one-semester course, the student can read 
approximately one chapter per week and perhaps dcsipn a study of 
his own; for a more extended course, each chapter can be cnriclicd 
'xith supplementary rcadiny^. Students minht also be asked to actually 
complete their tliese'- if the course can be carried out over a year’s 
time. 

1 am indebted to a number of persoiw who were extremely helpful in tlic 
preparation of thi’> mami'.cript; Mrs. Jane 1‘ujilani typed all corrections in 
the oricinal and in subsequent copies; Miss (layie Ouyc typed the final 
manuscript; Mrs. k'ire.ima Kemble, Miss Fthcl Oda and Mrs. Nona Springcl 
were responsible for checking bibliographical references for accuracy and 
completeness; yjiss Cathy Wentworth read the final page proofs; and 1 
am indebted to the l.iterary Fxccutor of the late Sir Ronald A. Fisher, 
F.R.S.. Cambridge, and to Oliver A: Boyd Ltd., Fdinburgh. for their per- 
mission to reprint from their book The Design of ICxpcrirnt-nis. To all 
these persons. 1 owe a debt of gratitude. 

Various pans of the text were read and critiqued by Dr. David G. Ryans, 
Dr. George I'ujita, Dr. Robert Clopton. Dr. Donald Fit/gerald, Dr. Donald 
Lcton, Dr. Julian C. Stanley, and Dr. Ted Husek. Dr. Agnes Niyckawa 
read the entire text and made numerous helpful suggestions. To all of these 
persons, 1 am deeply grateful. They are, of course, not responsible for any 
errors of omission or comission which may have occurred. 

Writing a textbook requires that an author neglect his family and friends. 
To them all 1 owe a special debt of gratitude and it is to them that I 
dedicate this text. 

Gilbert Sax 


Seattle, Washington 
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CHAPTER ONE 


The Scientific Basis 
of Education 


At no time in man’s liistory has the need for more reliable knowledge con- 
cerning education been as keenly felt as it is today. The schools, at one time 
agencies dedicated to the education of the elite, have been changing their 
functions, their curricula, and their methods to accommodate ever-expanding 
demands from a society that has insisted upon quality education for all of its 
children. 

It is not surprising, considering the many changes in education over the 
past half ceniun.’, that educators have lacked the knowledge needed to justify 
these modifications in educational practice. Instead, many Justifications were 
based, at least in part, on the biases of individual educational reformers, on 
appeals to authority, or, perhaps even worse, on dogmatic assertion. Under 
such conditions it was easy for subjectivity and bias to override objective and 
empirical methods of studying educational problems. 

This lack of valid knowledge and the concomitant dependence on prescien- 
tific ways of thinking not only allowed unexamined practices to continue 
but also prevented a number of worthwhile educational experiments from 
being conducted. In 1897, for example, J. M. Rice asked the participants at 
the annual meeting of the Department of Superintendence how it would be 
possible to determine if students who are given 10 minutes of spelling each 
day learn any less than those who are given 40 minutes each day. He dis- 
covered that some people in education did not even believe an answer to this 
question was possible. Rice stated, “ to my great surprise, the question 
threw consternation into the camp. The first to respond was a very popular 
professor of psychology engaged in training teachers in the West. He said, 
in effect, that the question was one which could never be answered; and he 
gave me a rather severe drubbing for taking up the time of such an important 
body of educators in asking them silly questions.”' 

' J. M. Rice, Scientific Management in Education (New York: Noble & Noble, Pub- 
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Dependable knowledge about education has come from many different 
sources. At the beginning of the twentieth century educators could not easily 
imagine that scientific methods could provide answers to questions that had 
interested man for the preceding two thousand years, and it was little wonder 
that Rice had difficulty persuading the members of the Department of Super- 
intendence to accept these methods. The prevailing attitude was that educa- 
tional problems could be resolved through appeals to five sources: common 
sense, authority, intuition, revelation, or “reason.” 


The Appeal to Common Sense 

The appeal to common sense can be considered from two points of view: 
as a means for justifying” preconceived beliefs or as a way of referring 
to empirically verified knowledge that has been generally accepted. When 
used to justify preconceived ideas, the appeal to common sense stifles com- 
munication and prevents or discourages experimentation. Too often, scien- 
tific invesflgation is considered unnecessary as long as common sense pro- 
vides justification for our beliefs. Thus, as long as common sense dictated 
that the study of difficult subjects such as Latin, Greek, or mathematics 
would exercise the mind,” there were few demands for experimental investi- 
gation of the matter. Indeed, in 1892, when President Eliot of Harvard was 
appointed chairman of the Committee of Ten on Seeondary School Studies 
y the National Educational Association, the Committee recommended 
^at all subjects in the curriculum be accepted as equivalent in value. The 
Committee further stated that only difficult subjects could be counted on to 
exerci^ the mind. The implementation of the Committee’s recommenda- 
tions e to a sterile, difficult, and impractical curriculum which did much to 
eliminate many of the less able students from the public schools. These 
common sense” beliefs were not tested until the first quarter of the twentieth 
century when sufficient empirical and experimental evidence had been 
accumulated to discredit many of these ideas. 

The second meaning of common sense” refers to generally accepted, 
empirica y veri ed knowledge. In this definition, information derived through 

m a body of already investigated data which may be 

modified as additional evidence is obtained. Thus, the present-day educator 
may take it for granted” that quiet children are not always the best-adjusted 

accepted. Nonetheless, these “common 
e le s can e re-examined and reformulated as new information is 
accumulated. 


The Appeal to Authority 

acceptance of someone else’s position has retarded knowl- 
retarded knowledge in other disciplines. 
Throughout history, there have been men who were castigated because they 
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refused lo accept the word of some “authority." In the Middle Ages, the 
teachings of .'Nnstotlc and tlic Church were used as a means of coercing peo- 
ple into “accepting" current religious practices. In more modern times, 
references to .lohn Dewey or Robert Maynard Hutchins as authorities in 
education have been used to justify one's own position and to stifle communi- 
cation and inquiry. When an argument is started with “Dewey said . . . ,” 
it is assumed that there is little need to discuss the matter further. 

The appeal to authority is not always an unreasonable way of dealing with 
certain kinds of information. Knowledge has grown too rapidly for anyone 
to be cquallv' competent in all subjects. Thus, we are forced to aceept some- 
one’s word if we cannot, either by aptitude or inclination, obtain the evidence 
for ourselves. 

Mandcr’ has proposed four criteria for evaluating the extent to which a 
statement may be considered authoritative. First, the individual who is being 
judged as on expert or specialist should be identifiable. Tliat is, we must be 
able to discover the name of the person who has made a statement designed 
to be authoritative or who has advocated some position. If we want to be 
precise, we cannot say “Many educators believe ...” or “Specialists in edu- 
cation claim . . . ." without identifying just which educators or specialists 
we mean. In scientific reports or in theses or dissertations, the author is re- 
sponsible for providing the reader with a reference to these specialists so 
that they may be identified and their positions evaluated. 

A second criterion suggested by Mander is that the authority should be 
recognized as such by members of the profession in whieh he claims compe- 
tency. His membership in professional societies and his reputation among 
his colleagues may be used as a rough but useful measure of the extent to 
which the authority’s statements have the sanctions of that professional 
group. To be sure, the danger always exists that personal prejudices may 
discredit some member of a profession, or that legitimate contributions 
which are extreme and not well recognized within a profession may be dis- 
credited by the general membership. Nonetheless, failure to apply this crite- 
rion can lead to an intellectual anarchy in which the persons most capable 
of evaluating a statement are denied the opportunity to do so. 

A third criterion is that the cited authority should be living. In ancient 
Greece, Aristotle could reasonably have been considered an “expert” in mat- 
ters relating to science and logic; however, he could only be considered an 
expert in science today if no important or contradictory facts or arguments 
had come to light since he died. Similarly, it may be quite reasonable to quote 
John Dewey’s position on a number of matters if the purpose is to present 
historical information. But unless we are certain that no contradictory evi- 
dence has come to light since Dewey’s death, a reference to him should not 

^ E. Mander, Logic for the Millions (New York: Philosophical Library, 1947), pp. 
57-60. 
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be used to “prove a point." Dewey himself might wish to change his position 
if he were alive to examine new evidence. 

The fourth criterion is tliat the authority should not he biased. That is, 
we need to know whether or not his prejudices, biases, and stereotypes are 
interfering with his making a clear and rational judgment. Admittedly, such 
an evaluation is difficult, but difficulty should not prevent us from trying to 
make these judgments if it is possible to do so. 

The Appeal to Intuition and Revelation 

Revelations are direct and immediate insights concerning “truth" or “real- 
ity”; they are often presumed to originate from God. If these hunches or 
experienees are believed to have “natural” origins, they are called intuitions. 

At one time or another, each of us has probably experienced intuitions 
or hunches telling us, for example, that we should not trust a person we have 
just met, or that taking a particular fork in the road when lost would lead us 
to our destination. These intuitions, derived from past experiences with simi- 
lar phenomena, may or may not provide us with dependable knowledge con- 
cerning the expected or predicted consequences of the decisions we make. 
The stranger we distrusted may, if given the opportunity, turn out to be 
a loyal and good friend; the unselected road may have led us home more 
quickly and safely than the one chosen on the basis of “intuitive” feelings. 
Intuitive feelings cannot always be trusted without empirically verifying their 
consequences. 

In a sense, the scientific hypothesis or hunch concerning the expected 
relationships between variables is a sophisticated and highly refined form of 
intuition. Suppose that a scientist is interested in studying test difficulty levels 
and their possible effects on student achievement. To investigate this problem, 
he hypothesizes or suggests that achievement will be facilitated by hard (or 
easy) examinations. These expectations are derived from his past experiences 
with similar types of phenomena. In each case, the scientist empirically veri- 
fies or disproves his expectations concerning these relationships. In contrast, 
the appeal to intuition does not necessarily provide for confirmation of one’s 
beliefs. 

Revelations are more difficult to analyze than are intuitions, since their 
source is presumed to originate outside of man’s experience. Because the 
belief in a supernatural existence rests upon faith, the scientist has no way of 
validating or invalidating revelations unless they contradict empirical experi- 
ences. Proclamations that the world will end on a certain day are invalid 
when that day has passed safely, no matter what the source of the revelation 
may be. If there is a conflict between a private “revealed truth” and empiri- 
cally derived knowledge, the strength of the argument will favor empiricism. 
Even though there is nothing final or absolute about scientific knowledge, 
the methods employed by scientists involve a set of rigorous criteria for evalu- 
ating truth. Anyone interested in examining a scientific finding can do 
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so provided !ic i*; copablc of following the methods used by the scientist. 
The private nature of a revelation makes it impossible to examine it openly or 
to duplicate it for further con‘>idcration. Thus, while the revelation may have 
tremendous importance for the person experiencing it. its private nature does 
not prtavidc a very comincinc argument for others to accept whatever 
'‘truth" has been revealed. 

The .\ppcal to Reason 

Rationalism is the philosophic position that places reason over both 
revelation and experience. In general, rationalists take the position that 
concepts such as God. causality, or mathematical “proofs" do not depend 
upon either experience or revelation but can be proven through rational 
processes, especially deduction. 

Deduction is the process of drawing specific conclusions from premises in 
a form known as a syllogism. The most common type is the categorical syl- 
logism. which takes the form 

AH A is li (or. for example. .All men are mortal) 

C is A (.Socrates is a man) 

Therefore, C is 1) (Therefore. Socrates is mortal) 

The conclusion that Socrates is mortal is a logical deduction from the 
major premise that ".All men arc mortal" and from the minor premise, 
“Socrates is a man." Since we arc setting equalities equal to each other 
(A = D; C - A; therefore, C - B), the conclusion is valid. 

Deduction is not an unreasonable way of deriving knowledge. Mathemati- 
cal reasoning, for example, is dependent upon rules of logic which specify 
the definitions of various terms and their interrelationships. The scientist 
employs these rules and definitions to help him derive relationships and specif- 
ic conclusions. For example, it is a simple matter to demonstrate mathemati- 
cally that adding a constant to a series of scores will augment the mean of 
the original scries by the value of the constant. This can be accomplished by 
1) defining each term needed and 2) performing operations in accordance 
with rules that do not violate logical principles. 

It is one thing to consider deduction as an auxiliary and useful methodol- 
ogy; it is quite another matter to believe that it is the primary method for 
deriving all “truth.” In deductive reasoning, the conclusions may tell us noth- 
ing about “reality,” since we may have major or minor premises which 
themselves do not correspond with the “real” world. Thus, we are on safe 
ground when we state that “All men arc mortal,” since “mortal” and “men” 
are semantic equivalents. But nothing prevents us from stating “All men are 
elephants” and “Socrates is a man.” The conclusion must then be drawn 
that “Socrates is an elephant.” Note that the rules of logic do not specify 
what the empirical relationships must be between men, elephants, and 
Socrates. Conclusions may be logically derived although premises are 
incorrect. 
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SCIENCE AS A SOURCE OF KNOWLEDGE 


This text takes the position that science provides the most reliable means 
for obtaining knowledge about empirical relationships and that education 
can be studied scientifically. The acceptance of this position does not neces- 
sarily exclude appeals to common sense, authority, intuition, or reason as 
long as these appeals do not violate those characteristics of science we shall 
consider later in this chapter. 

The term science has been used in so many different ways that we must 
consider its meaning in greater detail. In attempting to win an argument, 
for example, it might be argued that the opposition does not really have the 
facts correct because “Science has proven ...” or because “It is a scientific 
fact that .... The argument that begins “Science has proven ...” assumes 
that counter-arguments are invalid. To use science in this way is to establish 
its principles as authoritative without the necessity of providing evidence 
for one s beliefs. To assume that seientific “truths” are not to be questioned 
is to misrepresent the very meaning and purpose of science. 

A second meaning of the word science is implied in the expression, “He 
has that down to a science.” Used in this sense, science refers to some skill 
which has been perfected to a high degree of sophistication; it thus refers to 
and implies exactness, precision, and perfection. The layman expects science 
to allow for no error at all. But science, of course, cannot be independent of 
scientists, and wherever human beings are involved, some degree of error 

and inexactness is to be expected. We will examine this concept in more detail 
later in this chapter. 


A third meaning of science is implied in such expressions as “scientific 
ar ering or scientific housecleaning methods.” In these examples, science 
IS used as an honorific designed to raise the prestige value of these activities, 
ust ow scientific barbering” differs from the ordinary kind is never really 
considered seriously by those employing the term. The intent is to impress 
rather than to explain. 


ourth meaning of science refers to an organized body of knowledge, 
sue as library science or political science. If this organized body of knowl- 
edge IS based primarily on deductive rules it is called a. formal science, to 
inguis It rom t ose areas of knowledge that depend primarily upon 
empiricism and induction. These are called empirical sciences. Considered 
rom IS point o view, mathematics, logic, and library science are primarily 

orma sciences, w ereas chemistry, psychology, and education are primarily 
empirical sciences. 


a number of difficulties in defining science as a body of knowl- 
ph!p h f for example, is a highly organized body of knowl- 

wpU ^ ^ Alohemy and astrology were also 

fnrm J c Sciences as the term is used today. Rather they 

rp5nr.nH u.” osciences, since the methods they employ do not cor- 
respond to those required for modern science. 
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>U'>st Fcic?ui<-t‘i today con-^idcr science from a fiftli point of view, that is, 
as a mctliod or attitude. .As a mcliiod. empirical sciences cotisist of controlled 
obserxations combined to form “an interconnected series of conceptual 
schemes . . . fruitful of further experimentation and observation."’ Observa- 
tions arc controlled by eliminating or reducing the effects of irrelevant or 
extraneous variables by means of apparatus, tests, examinations, instruments, 
or speciahVed techniques. These observations arc combined to form l/icorcti- 
ca! .\y.ucni<^ that arc useful in explaining and predicting the relationships be- 
tween the obserxations. 

.As an attitude, science consists of a willingness to examine and. if need be, 
to modify or repudiate one’s own beliefs, ideas, or methods as new or more 
reliable evidence is obtained. The attitude is one that encourages the scientist 
to control and reduce biases, to be as precise as possible, to verify or disprove 
his beliefs cmpiricall) . and to organize empirically obtained data into a mean- 
ingful body of theoretical knowledge. 

There is no ncces'.arx conflict between thinking of science as a method and 
thinking of it as an attitude, as long as method is defined broadly. Certainly 
we do not mean that astronomers, chemists, and p.sychologists use the same 
specific techniques for obtaining data; we do mean that all sciences arc con- 
cerned with obtaining the most reliable empirical observations possible, 
even though the specific techniques for obtaining this information may dilTer 
widely. 


CHARACTERISTICS OF SCIENCE 
Reduction and Control of Bins 

The scientist is a human being and, like others, he is not without preju- 
dices, biases, and misinformation. The conception of the scientist as a cold, 
detached, and impersonal individual reflects a popular but misleading stereo- 
type. In one study which explored the attitudes of high school seniors 
toward science and scientists, the investigator found that scientists were 
considered to be “longhairs,” “shy, lonely individuals,” “odd,” “eggheads,” 
and “communistic.” They “have physical deformities which render them 
unfit for other work,” “cannot have a normal family life,” and are “unsoci- 
able.”' 

This stereotype of the scientist is not unlike the character of Dr. Franken- 
stein as displayed in the films! It may very well be ihaisome scientists are odd 
and unsociable, but these are the exceptions, not the general rule.= A number 

sjames Conant, Science and Common Sense (New Haven: Yale University Press, 1951), 
P. 25. 

'Hugh Allen, Jr., Attitudes of Certain High School Seniors Toward Science and Scientific 
Careers (New York: Bureau of Publications, Teachers College, Columbia University 

Press. 1959), pp. 14-15. . 

‘Paul F. Brandwein, “Creativity and Personality in the Scientist, Rethinking Science 
Education, 59th NSSE Yearbook, Part 1 (Chicago: University of Chicago Press, 1960), 
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of eaFly writers such as Lombroso," Kretschmer,' and Lange-Eichbaum® 
helped popularize this misconception of the scientist and made it difficult 
to consider scientists favorably. This stereotype may be responsible for dis- 
couraging students from becoming scientists or from engaging in scientific 
pursuits. 

The emotional sterility often inappropriately demanded of the scientist 
would no doubt interfere with some aspects of scientific progress. Nothing 
would be more boring than having to compute pages of statistics, score in- 
numerable tests, or read countless articles without a driving and compelling 
interest either for this type of work or for the end product of these activities. 
The very selection of a research problem is a value judgment made by the 
scientist, and his interest in doing one type of research rather than another 
reflects this personal preference. 

In another sense, personal preferences may interfere with scientific pur- 
suits. We can understand the scientist’s preference for one type of research 
over another and for one procedure over another, but it is quite another 
matter if he allows his personal values and biases to interfere with the methods 
he employs in solving some problem, or if he allows his prejudices to interfere 
with the conclusions he draws from his data. It is one thing when the scien- 
tist s preferences lead him to work on problems of compelling personal in- 
terest; it is quite another matter when he systematically excludes evidence 
that is contrary to his personal beliefs. 

The Quest for Precision 

In the high school science survey referred to earlier,® almost half of the 
seniors ^agreed with the statement; “Scientific findings always lead to final 
truths. What these seniors believed was that science cannot err and that 
“final truths” are obtainable. 

Science demands as much rigor and exactness as can be mustered, but this 
demand should not be confused with a search for absolute or irrefutable 

truths. Man can depend only upon himself, his methods, and his tools in 
his atternpt to understand his environment; he has no appeal to higher “au- 
thorities to validate his methods or conclusions. 

Our culture contains many examples which point out man’s quest for 
a solute knowledge and certainty. The young child looks to his parents as 
the source of irrefutable “truth.” Later, the teacher and the “expert” are 
considered the authorities. It is little wonder, then, that graduate students 

ee It IS time they are admitted to the “inner circles.” What they fail to realize 
IS that there are no absolute or final answers in science. 

“Cesare Lombroso, The Man of Genius (London: Scott, 1896). 

WoNd"?nf '^^931')"’^'^’ P^y^^hology of Men of Genius (New York: Harcourt, Brace & 

Ltd^'^igM)"^ Lange-Eichbaum, The Problem of Genius (London: Routledge & Kegan Paul 

^Allen, Atlilucfes, p. 24. 
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In an inccnioi!<i dcinomlmlion. Ilcrnatowicr and Kay pointed out man's 
search for certainty b> conslriiclinea Hlack Boy. containing objects of various 
sires and shapes. To determine the contents of tlic Black Box. their students 
were provided with apparatus such as thermometers, rulers, scales, and 
probes, which they could insert in small holes located on the walls of the box. 
In this demonstration, the students were asked to discover as much about the 
contents of the box as they could w ithout damaging it. Bernatow ier and Kay 
concluded : 

The most important lesson comes at the end of the critique when the 
students invariably ast, that the boxes Ivc oivcned to disclose what is "really" 
inside. Here we cmphasirc that it is futile to hope for final answers in science. 

In principle, the Black Box represents any problem in science. Bach problem 
is attacked bv nreans of observations which lead to interpretations .... To 
ask what is "really" inside is a futile question unle.ss one has .some definition 
bv- which he w ill rccopinre reality when he meets it. 

TIic matter of wanting the Black Box opened strikes us as a manifestation 
of a childlike desire for certainty. It betrays an inability to recognize that one’s 
ob.scrvaiions of the physical universe should lie the authority for his con- 
clusions about It. and that in such m.atters one can never hope to know in 
some .absolute sense. Opening the Bkack Box, "looking it up in the book." 
expecting some higher authority to grade us right or wrong are all alike in 
this regard. Tliey obscure the individual’s right and responsibility to gather 
evidence, to formulate opinions, and to live by the consequences of his own 
judgment. 

Bcrnatowicz and Kay were not suggesting that all observations arc equally 
competent or valid. Rather, we strive for as much precision and accuracy 
as our tools, resources, knowledge, and intelligence can give us, w'hile recog- 
nizing the tentative nature of all findings and conclusions. 

Verification 

The scientist reports his observations in such a way that not only he, 
but other investigators, can confirm or reject them. Thus he recognizes the 
fallibility of his own findings, and also recognizes that other individuals have 
the right to question and investigate these findings. This self-corrective 
function is perhaps the single most important aspect of science. In essence it 
means that the scientist has an obligation to present his evidence in a manner 
that allows it to be confirmed or rejected by other investigators. Science 
does not, or at least should not, have secret or sacred information. Indeed, 
scientific’ research depends upon other investigators checking on reported 

evidence and verifying or disproving it. 

The scientist can only work in areas in which verification is possible. Thus, 
on a rather simple level, it may be verified that a certain flower has five 
petals, that a given leaf is green, or that the sun is shining. On a more complex 


. j I- Aileron KTnv “Scietitific Attitudes, Certainty, and the 
’OAlbert J. Bernatowicz and E. ^bson K^, i>c enuu 

Black Box,” Journal of General Education, XI , 
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level, it may be verified that objects drop with constant acceleration or that 
planets closer to the sun travel at faster rates than those farther away. These 
more complex facts may be verified by taking careful observations and meas- 
urements. 

However, the statement “Honesty is the best policy” cannot be verified 
empirically. It is a value judgment which rests upon certain philosophical 
assumptions concerning the nature of man, the purposes of society, and the 
meanings of such words as honesty, best, and policy. Empirical observations 
can neither confirm nor invalidate value judgments since the criteria for evalu- 
ating them differ from those used to evaluate empirical observations. Value 
judgments can be tested by employing hedonistic, utilitarian, or perfection- 
istic criteria. Thus, the hedonist might construe honesty to mean “honesty 
to one’s self-interests”; to the utilitarian, it might be interpreted in light 
of its possible effects on mankind in general; and the perfectionist might 
conceive of it in terms of some ideal Utopian state. 

In contrast, empirical statements can be evaluated directly through obser- 
vation or indirectly by setting up consequences which themselves can be direct- 
ly observed. Thus, the fact that it is now daytime can be confirmed by looking 
outside or examining clocks graduated on a 24-hour basis; it can also be con- 
firmed indirectly by testing the consequences of its being daytime. We might 
argue, for example, that if it is daytime the stores, shops, and schools will 
be open. If they are, this is some evidence in our favor, but it is by no means 
conclusive, since stores, shops, and schools do stay open in the evenings from 
time to time and may be closed during the day on weekends or holidays. 
However, as we test the consequences of more and more propositions con- 
cerning the time of day, we can increase the likelihood that we will make 
a correct judgment. We shall return to this point in Chapter Five, when vve 
discuss the role of the hypothesis in scientific research. 

Empiricism 

Empiricism takes the position that observation and experience are the 
prime means of obtaining knowledge; it is the basic method of the sciences. 
At one time empiricists rejected all knowledge not derived from sensory 
experiences, including inferences drawn from deduction, intuition and 
revelation, and theory. However, a less extreme empiricism is generally 
accepted by a majority of scientists today. This more moderate position 
encourages the development of theory and allows for deduction, but denies 
intuition and revelation as sources of knowledge. The empiricist would 
insist, however, that theories yield consequences which may be empirically 
verified. 

The basic form of reasoning used by empiricists is induction, which draws 
general conclusions from specific observations. Inductive reasoning follows 
the general form 
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Ob'^crvalion 1 
Observation 2 
ObNcrvation 3 


Ob'icrvalion r, 


Gcncraiiralion from observations I . . . n 

In induction, ob'-ersation'^ 1 throiieh n arc made; from them the scientist 
attempts to induce a ccncral principle. Whclbcr or not tbc generalization is 
valid depend'i in part on the form or-type of induction being employed. If 
we have knowledge of all olwcrvations comprising some universal or totality, 
we can summarize that which holds true for all members of the set. Thus, 
if we know that teachers I through n in a given school district arc females, 
we can claim that all arc females, since we have complete knowledge of all 
elements entering into the set. Where this is so. the process is called perfect 
induction or induction hy conipicie enumeration, l-ssentlally, perfect induction 
is a statement summarizing w hat is known about all members of any given 
totality. 

Usually we do not have complete knowledge of all elements comprising 
any given set. either because the elements arc infinite in number or because it 
may be extremely difllcult or expensive to examine them all. In cither case, 
the scientist works by selecting samples to represent all of the elements in 
any given universe (see Chapter Six) in the hope of drawing conclusions from 
the sample that can be gcncraliz.ed to the universe as a whole. If sampling is 
involved, the form of induction is called imperfect, to indicate that conclu- 
sions do not necessarily or logically follow from the enumeration of limited 
numbers of observations. How'cver, the scientist often can estimate the 
amount of error there w'ill be when he generalizes from the sample to the 
universe. 

There are a number of criteria that can be used to evaluate imperfect 
inductions. In general, we arc likely to make fewer errors if we can examine 
a large proportion of the elements in the universe. For example, we now have 
accumulated thousands of observations verifying that the sun rises in the east. 
The first criterion argues that the more of these observations we can get, 
the more certain we can be that the sun will always rise in the same direction. 
However, this criterion, while necessary, is not sufficient because we also need 
to know the number of negative instances, or times the sun failed to rise in 
the predicted direction. Here again, we have no negative instances and the 
generalization seems even more plausible. Still, for the third criterion, we must 
know how capricious the phenomena are which are under investigation. 
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Some phenomena, sucli as liuman behavior, may vary considerably, while 
others obey laws that are unlikely to change. The laws of motion that govern 
planetary movements are highly stable, and we can predict that, as long as 
the solar system is not disturbed, the sun will always rise in the east. It is im- 
portant to note that this conclusion was not drawn only from the fact that the 
sun has always risen in the east: the number of negative instances and the 
variable nature of the phenomenon under investigation also had to be con- 
sidered. 

We pointed out earlier that scientists depend upon rational as well as 
empirical methods. Mathematics, for example, is almost entirely deductive; 
yet, because there is an isomorphic relationship between it and the empirical 
world, the two can be extremely useful to each other. Mathematical models 
can help predict empirical relationships and these, in turn, can provide an 
empirical check on the model. Empiricism and deduction, then, can be mutu- 
ally rewarding. 

Theory Construction 

The word theory has been used in a number of different ways. In one 
sense, theory might be considered to be at one end of a continuum with 
practical” matters at the other end. In this way, theory becomes a form of 
contemplation,' ‘ whereas “practical” matters involve actual manipulation, 
or “doing.” However, since science always involves thinking and contempla- 
tion, it is all theoretical to some extent. 

In another and more specious sense, theory may be considered as contem- 
plation which cannot be translated into any practical or useful activity. 
Campbell has stated, “The idea that there are propositions ‘true in theory, 
but false in practice has its foundation only in the incompetence of the unini- 
tiated to understand theory, and in their habit of applying propositions to 
circumstances entirely foreign to the theory. To those who have not the 
power to think, theory wilt always be dangerous.”'^ 

A theory is a unified system of principles, definitions, postulates, and observa- 
tions oiganized in such a way as to most simply explain the interrelationships 
between variables. Since nature does not organize and interrelate objects, 
events, or methods for us, it is up to man to organize nature in the manner 
most meaningful for the purposes at hand. Thus, while it might be quite 
reasonable for some purposes to classify all objects as large or small, it may 
be less meaningful to do so when constructing kingdoms in biology. 

Cohen and Nagel have emphasized that neither isolated facts nor organized 
information alone can be considered as science. 


"Norman R. Campbell, Foundations of Science: The Philosophy of Theory and Experfi 
went (New York. Dover Publications, Inc., 1957) p. 120. The qu otation was 
published in Norman R. Campbell, Physics: The Elements and is reprinted here by permis- 
sion of Cambridge University Press. 

'-Campbell, Foundations, p. 121. 
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Inlormitipr). ro liow rc!i.il'!c or cvlciTii^c. wiiich consists of a set 

of Isolated proroMiio;-,^ o no! ';c:cncc. A tctcplionc I'ook. a dictionary, a cook- 
I'ooV. or a \vci'-ordrrcd catalopnc of pood<; sold in a general store may contain 
kr,o\s!cdpc. o;pan-.rcd m -^omc cor.scmcnt order, lull \sc do not regard these 
a<; work', of 'ctenec. .’'c:cncc require' that onr propositions form a logical 
syMcm.’ 

Thus, eimply to dc'.erihe the events which occur in largo numbers of class- 
rooms ie not science, even though sncli information has been gatliered by the 
most careful obscrv.ations. Nor can wcll-organired class rosters be considered 
as science. Tiicy simply c\ist as isolated examples of internally organized 
information that dors not help to predict or explain the relationships between 
variables. On the other hand, the atomic theory consists of definitions, as- 
sumptions. and empirically confirmed facts which are interrelated to provide 
an explanation of natural events. 

Tlic Role of Induction in nicorx' Development 

The role induction plavs in developing a theory may be shown by an 
example. Suppose that the following ’‘facts” have been verified, reconfirmed, 
and arc universally "accepted": 

1. There is a positive relationship between the amount of material which has 
been forgotten and the amount of time which has passed since the material 
was originally learned. 

2. The beginning and end of a memorized list will be retained to a greater 
extent than will material in its center. 

3. After sleeping, pupils can recall data they could not recall the night before 
(the “reminiscence" effect). 

4. The more material learned, the more forgetting is likely to occur. 

The scientist attempts to develop or induce from particular observations 
a theory or generalization which will explain all four facts. Suppose that the 
following statements are considered as possible explanations: 

a. Theory of Disuse: Forgetting occurs because material which has not been 
practiced degenerates. 

b. Psychoanalytic Theory: Forgetting occurs because unpleasant memories 
are repressed. 

c. Interference Theory: Material learned early in a sequenee interferes with 
the learning of later material (proactive inhibition), and material learned 
later in a sequence tends to interfere with previously learned material 
(retroactive inhibition). 

To what extent does each of the three theories explain all of the facts? 
The Theory of Disuse can account for the apparent “decay” of memory over 
time, but it does not explain facts two or four and is in direct contradiction to 
fact three. 

'^Morris R. Cohen and Ernest Nagel, An Introduction to Logic and Scientific Methods 
(New York: Harcourt, Brace & World, Inc., 1934), p. 129. 
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The Psychoanalytic Theory may partially account for the so-called remini- 
scence elTcct, but it docs not explain the other facts. The only theory which 
seems to account for all of the facts is the Interference Theory. It explains 
fact one by asserting that more interference is possible over long periods of 
time than over shorter intervals. It explains fact two on the grounds that the 
terminal part of any sequence to be memorized can only be interfered with by 
preceding parts (i.c.. affected proactively), while the beginning of the sequence 
can only be affected by material which is learned later on (affected retroac- 
tively). However, the material in the center of the sequence is alTccted by pre- 
ceding as well as by following events and thus becomes most interfered with 
(affected both proactively and retroactively). The Interference Theory only 
partially explains fact three by postulating that during sleep there is little 
chance for interference to occur. Fact four is explained by the greater amount 
of interference possible with a larger amount of material to be learned.'^ 
In the process of induction, one ordinarily tries to account for as many facts 
as possible, by developing the fewest number of theories or explanatory 
generalizations. The most useful theories are those which most adequately 
and simply explain the greatest number of relevant facts. 

The Relationship Between Theories and Facts 

The researcher developing a theory must be willing to modify it to account 
for discrepant facts; the opposite process, modifying facts to conform to a 
pet theory, has been called “Maier's Law.”'^ It states: “If the facts do not 
conform to the theory, they must be disposed of.”'° Maier has indicated a 
number of ways facts have been ignored to perpetuate a poor theory. One 
way is to give the facts a new name. 

Giving disturbing facts a name is almost as good as explaining them 
because a name supplies a useful answer to inquisitive people. For example, 
a lecturer in describing the habits of people living near the North Pole told 
his audience how children ate blubber as if it were a delicacy. Later a ques- 
tioner asked the speaker why these children liked a food that would not 
be attractive to children living here. The lecturer replied that this was so 
because the children were Eskimos. The questioner replied “Oh, I see” and 
was satisfied. In a similar manner the word “catharsis” explains why we feel 
better after expressing pentup feelings.'^ 

Facts may also be disregarded in another way. According to Maier, th^ 
most efficient way of eliminating facts that do not correspond with theory is 
to fail to report them. 


'^The reader should recognize that these “facts” and “theories” were oversimpl'fie<| 
to make the process of induction clear. As such, the example is illustrative but does no 
accurately correspond to the actual facts or theories. 

i^N. R. F. Maier, “Maier’s Law,” American Psychologist, XV, No. 3 (1960), 209-212. 
'®Maier, “Maier’s Law,” p. 208. 

'^Maier, “Maier’s Law,” p. 209. 
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N.itural]) it t.rVc' a critscal uuli\ iiliial to ilcicrniiiic what is worth reporting 
and what i'- irTclc\ ant. Tor c\antp1c. one rcscarclicr reported that his experi- 
ment on dcla>ed reaction was condiictcvi on tlic third floor of the building 
hut did not tell how mans tests he ran in a day. Later it was found that the 
number of tests per day determined the length of a delay, while the floor 
used was not important. .Smec selection is absay.s with us. what better aid is 
there for the selecting of facts than a good thcorv .'' 

The rclationsliip of Ltd tvs theory has not tilways been well understood by 
many researchers. Tile student should keep in mind how theory may be used 
to clarifs facts and how facts may be used to validate theory. Van Dalcn'” 
has indicated a number of wa>s in which theory and facts arc interrelated; 

1. Ti:cory licUr.cs the releutiuy nf fuels. Not till facts arc of equal 
value. Some facts, .although liighK dependable, may not he related to any- 
thing of immediate importance. Thus we could collect facts about the sizes 
of foreheads of clcmcnlars school children or try to determine the number 
of songs seniors can learn oscr a nisen period of time. But tlicsc facts, once 
obtained, have limited .applicability. Having a theoretical structure Iiclps 
determine which Linds of facts arc needed to validate or invalidate a given 
thcorxa 

2. Theory ilcvelups systents of e/ossifieatioii oiu/ a strucltirc of concepts. 
Since nature docs not provide iis with a ready-made system of classifying ob- 
jects. events, or methods, it is up to man to organize facts in such a way 
that they become useful. A theoretical structure liclps the scientist — whether 
he is a physicist or an educator — to organize his facts by relating them to a 
broader concept of theory. 

3. Theory summarizes fuels. It may be extremely difl'iciilt for the scien- 
tist to retain large numbers of seemingly unrelated facts. However, as a theory 
is developed which encompasses thc.se facts, he can summarize large masses 
of data by subsuming them into a meaningful structure. Thus, one theory 
may explain a large number of facts. 

4. Theory predicts facts. One of tlic major purposes of theory is to 
predict events in the absence of direct evidence. A novice teacher, for example, 
may have rather specific questions concerning the behavior of a given child 
in his classroom. He may want to know why the child is continually hitting 
other children in the room. Without the benefit of theory he would have to 
investigate in detail the characteristics of every child before he would be in a 
position to discuss aggressiveness in children. Once a theory has been estab- 
lished and confirmed in a number of different situations, it enables him to 
predict within the limits of probability what will happen when certain events 

'®Maier, “Maier’s Law,” p. 210. 

'‘'D. B. Van Dalen, “The Relationship of Fact and Theory in Research,” Educational 
Administration and Supervision, XLV, No. 5 (1959), 271-274. 
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occur. Thus, a psyclioanalylic theory might suggest that aggression is dis- 
placed hostility; another theory may suggest that it is related to the amount 
of frustration experienced. No matter wliat tlie specific form of the theory, 
it allows the teacher to predict what the child will do. and may offer an expla- 
nation for his behavior. 

5. Theory points out needs for further research. A fruitful source of 
research topics can be found by attempting to confirm or refute theories 
already proposed. All theories — and especially those in the social sciences — 
arc tentative formulations which can be changed to conform to known facts. 
By examining areas where there is a lack of information, the researcher may 
find useful ideas. 

An example may help to clarify this process. Suppose one does accept the 
Interference Theory of forgetting (see page 13). One way of selecting a re- 
search topic is to test the implications of the theory itself. For example, the 
Interference Theory states that retention is a function of the amount of 
interference. Suppose that this theory is tentatively “accepted.” What should 
we then be able to predict concerning forgetting? We might predict the very 
“facts” listed on page 13. These facts then become a possible topic for in- 
vestigation. Each theory should be able to generate hypotheses which can be 
experimentally tested to clarify, expand upon, and delimit various aspects of 
the theory itself. 

So far we have indicated ways in which theories contribute to knowledge. 
It is also true, however, that facts contribute to theory.-” First, facts stimulate 
theory construction. As more and more facts are added to any body of knowl- 
edge, the need to organize and explain these facts increases correspondingly- 
As this organizational process continues, it forms the nucleus for the develop- 
ment of theory. Thus, it is quite reasonable to select research topics to obtain 
facts, which in turn develop some body of theory. 

It is also reasonable to select a research topic which has as its intent the 
testing of the implications of a theory. For example, the theory behind pro- 
gressive education assumed that the “problems approach” to the teaching 
of arithmetic was “superior” to more deductive approaches. A study by 
Sax and Ottina^' indicated that children from progressive schools did no 
better than their matched counterparts in traditional schools on tests involv 
ing arithmetic meanings until they reached the seventh and eighth grades, 
then, significant differences were found in favor of children who atten e 
progressive schools. These facts help to redefine the scope and extent oft ^ 
theory of progressive education. 

Simplicity 

The so-called Law of Parsimony states that of several equally suitabl 
theories, science will tentatively “accept” the simplest. The Law of Pars' 

-“Van Dalcn, “The Relationship of Fact and Theory in Research,” pp. 273-j-274. 

“'Gilbert Sax and John R. Ottina, “The Arithmetic Achievement of Pupils ^ 

School Experience," California Journal of Educational Research, IX, No. 1 (1958), 
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ri'.pny. she rnncn'lc o!' O^-cain''- Iv.Tror tn.inicti .iftcr \ViIIi;ini of Occ.ini. 
ul'.p '-ucccMcm “cDlisie luir.ccc'.'i.iry c\pI.iti;ilioii‘>). i‘< not so much n 

l.iu .-j*. !i !' .-i ^’,;c.TC'!:on the <.C!cn{i<-! to make explanation'^ and theories 
a'- '■inrpk a,'- he can. It adxoc' the rc‘>carchcr to conceptuah/e his propositions 
in the simplest tcrir.s pos<,iMe; oi\'oursc it viocs not suggest that lie oversim- 
phi's complex a:u1 relevant data. 

\n example ofthc use oftlic Principle of Occam's Ra/or may liclp to clarify 
it. Suppose th.at a resrarchicr mafes the following '‘discoveries": 

1. From x.M. to M \.x(. there arc no students at A' High School. 

2. The inimi'er of stuiients remains constant from 8:00 .x. si. until 3:00 r.M. 
cacli sF'ix fri'in Moiulav tlirsnigh F'rida>. 

3. From ,* oap.M, until -5 00 r.xt. the number of students on campus con- 
timiallv diminishes. 

4. F'rom 4 O;0 r.x!. until S OO \.xi. the following day there arc no students 
evn campus. 

Assuming that these facts nia> be verified, what explanations or theories 
can account for all of them One possible theory is that policemen arc posted 
around the campus Keeping students out until 8:00 a.m. and not letting them 
leave until 4:O0 I'.m, .Another plausible theory, which also accounts for all 
ofthc facts but is somewhat simpler, is that classes do not begin until approxi- 
mately 8:00 A.xt. and that school ends at 3:00 p.m. A third theory might be 
that students have to help their parents at home until school begins at 8:00 
A.M. and are recjuired by their parents to be home to do chores no later than 
4:00 p.M. 

Each of these three theories accounts for all of the facts. The first theory, 
however, does so only by adding the role of a policeman. Like the third 
theory, it requires additional propositions to explain the phenomenon ade- 
quately. The second theory, howevcr.cxplains all of the facts without elaborate 
additions. Therefore, it is simpler and needs no additional postulates to ac- 
count for all of the events. 

One caution is in order at this point. The Law of Parsimony does not state 
that only simple theories can be accepted, nor does it state that complex 
explanations arc inappropriate. In addition, acceptance of an explanation 
does not necessarily indicate complete agreement. Adherence to the prin- 
ciple of parsimony does, howev'cr, assume a hierarchy of tentative explana- 
tions, each of which must be tested in greater detail. Thus, the researcher 
“accepts" an explanation only in the sense that he plans to investigate it 
first. 


SOME ASSUMPTIONS MADE IN SCIENCE 


Determinism 

Determinism is the philosophical assumption that the universe is orderly, 
lawful, and predictable. It is often contrasted with indeterminism, or vohmta- 
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rism,- wliicli postulates that man is not determined by his environment but 
is free to determine his own goals and beh.avior. A voluntaristic universe 
could not be studied because there would be no predictability, no stability, 
no order. 

In support of determinism, B. F. .Skinner, the Harvard behaviorist, has 
stated; 

Science attempts to discover order, to shosv that certain events stand in 
lawful relations to other events. No practical technology can be based upon 
science until such relations have been discovered. But order is not only a 
possible end product ; it is a working assumption svhich must be adopted at the 
very start. We cannot apply the methods of science to a subject matter 
which is assumed to move about capriciously. Science not only describes, 
it predicts. It deals not only with the past but with the future. Nor is predic- 
tion the last word: To the extent that relevant conditions can be altered, or 
otherwise controlled, the future can be controlled. If we arc to use the 
methods of science in the field of human affairs, we must assume that behav- 
ior is lawful and determined. We must expect to discover that what a man 
does is the result of specifiable conditions and that once these conditions have 
been discovered, we can anticipate and to some extent determine his actions.'^ 

Educational research presupposes that behavior is predictable and that 
events act lawfully in relation to one another. If this concept of determinism 
cannot be accepted, no science of education is possible. 

A number of arguments have been raised against determinism. One can 
argue, for example, that human beings are simply too complex to be studied 
scientifically. To this charge we can answer that modern experimental designs 
and the use of high-speed electronic computers have added greatly to the 
researcher’s ability to handle and control highly complex problems. To be 
sure, we know little about the behavior of children in classrooms, but there is 
no need to assume from this that the information is unobtainable. 

Two other points should be made. First, the concept of determinism does 
not (and indeed could not) require us to predict with certainty the results 
of any given action or behavior. The extent to which an event occurs or does 
not occur is defined by its probability of occurring: some events have near- 
perfect probabilities, others have extremely low ones. Events do not ordinar- 
ily occur as eitheiior propositions but in degrees of certainty ranging from 
zero to unity. 

Second, determinism should not be confused with fatalism. As Grun- 
baum states: 

The fatalist says that regardless of what we do, the outcome will be the 
same. By contrast, the determinist says that if we do such and such, then the 
effect will be thus and so. The fatalist thinks that if you go into combat, and 


22Gustav Bergmann, Philosophy of Science (Madison; The University of Wisconsi 
Press, 1957), p. 106. 

23B. F. Skinner, Science and Human Behavior (New York: The Macmillan Company. 
1953), p. 6. 
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if I'.illc! >o»r n.inic on it." you uili Iv Killed no nintlcr uhat 

yon do. . . . Tdc dclcrnnn;';! inAinf.Tin<; that a person will ilic on a certain 
day only if the condition,', uhich lead to death maleriali/e for that person 
on ih.at da\. indeed ilicy do at some tune for each of us. Unlike fatalism, 
dctcrrnir.iin-, .nlio-.vs cani.al etneaey to hvun.in aetions.'* 

Nature of Ucalils 

Titc \ cry i.ancu.acc we n^c to convey our Ihouclits .and ideas may presume 
a Knowlcdcc of “rcalitv." Tims, some scientists mipiil speak of “hody and 
mind." “method .and content." or “natural and supernatural." thereby as- 
suming ih.at the unuersc is composed of two separate and distinct types 
of rc.alitics. one Itasinp to do with substance and the other with “mind." 
Such persons (called ) conceive of “ultimate reality" as composed of 

both “phvsical" and “mental" entities. 

Others believe that “ultimate realilv" is composed only of “real, substantial 
entities, cxistinn in themselves and ordered to one another by c.xtramcntal 
activities.’"- Tlicse persons, called rc<j//.vr.v. conceive of a purely physical uni- 
verse which has an cMstencc independent of man. Still others may consider 
ideas as the “ultimate reality" and would deny a completely physical uni- 
verse; to philosophical idcalisis. reality consists of ideas. 

Mcfaphysics is that branch of philosophy concerned with the systematic 
interpretation of reality. Although the study of metaphysics is not itself an 
empirical or scientific enterprise, knowledge of one’s assumptions concerning 
the nature of the universe often directly benefits the scientist. These assump- 
tions. if not recognized and made explicit, arc likely to find their way into 
scientific reports. 

Consider, for example, an investigator who states, “Classroom learning is 
both intellectual and emotional.” He has assumed that there is a difference 
between intellectual and emotional learning and that both types exist. This 
is not a question which the scientist can resolve, because there is no possible 
way of verifying what "ultimate reality” is composed of. However, unless the 
student is aware of the metaphysical assumptions he is making when he uses 
words such as “absolute” or “relative” or makes distinctions between “na- 
tural" and “supernatural,” he is likely to be led astray by his own language. 

The importance of recognizing assumptions can be demonstrated by an- 
other example. Take the case of the investigator who states ; “The real problem 
of underachievers is their lack of confidence.” In this statement, he has made 
a number of assumptions. First, his use of the word “real” leads the reader 
to believe that there are at least two types of problems, one type which is 


^‘Adolf Grunbaum, “Causality and the Science of Human Behavior,” American Scientist, 


XL, No. 4 (1952), 671. 

^^John Wild, “Education 
opines and Education, 54th 
Press, 1955), p. 17. 


and the Human Society. A Realistic View,” Modern Philos- 
NSSE Yearbook, Part 1 (Chicago: University of Chicago 
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“real." “Iriic." and “absolute." wliose answers are discoverable if only we 
apply the correct methods, and another type which somehow is “false,” or 
“incorrect." However, there is no way to verify what a “real" problem is, 
since we have no appeals for empirical matters beyond ourselves. 

A second assumption concerns the meaning of undcrachicvcmcnt. The 
word “underachievers" assumes that there is a group of students who are 
achieving, or “working up to their ability.” Yet. on a moment's reflection, it 
seems clear that we have no measures of a student's ahilify obtained indepen- 
dently of his acliicvcinenl. 

It is the responsibility of the researcher to recognize the assumptions he 
makes. Research papers sometimes contain a section titled “Assumptions,” 
which forces the investigator to recognize and make explicit those beliefs 
he is asking the reader to take for granted. 

SOME POSSIBLE OBJECTIONS TO A SCIENCE 
OF EDUCATION 

The Problems of Applying Scientific Methods to the Social Sciences 

Objections have been raised to the consideration of education as a scien- 
tific enterprise. The most persistently voiced objection is that scientific 
methods, although they may be of value to the natural sciences, are inappro- 
priate to the social sciences. A proponent of this position has stated; 

If it is true that the truth can be discovered only in the laboratory, then we 
can know very little indeed about education; for we cannot know even 
whether the statement is true that truth can be discovered only in the labo- 
ratory. . . . What is called social science cannot tell us what kind of society 
we ought to aim at. It is doubtful whether it can even tell what the conse- 
quences of a given social policy will be. The reason, again, is the enormous 
number of variables that enter into any social situation. 

We can agree with the statement that the social sciences, particularly educa- 
tion, face innumerable difficulties in their attempts to solve persisting social 
problems, without accepting the premise that this knowledge is unattainable. 
If we reject scientific methods of solving human problems, we should be 
prepared to substitute some other method. Yet we know of none more 
rigorous than science in its approach or more likely to yield reliable empirical 
knowledge. 

Not all “truth” can be discovered in the laboratory, and the social sciences 
“cannot tell us what kind of society we ought to aim at.” Nevertheless, 
attempts to define the objectives of education that do not account for the 
psychological characteristics of children are likely to fail. These character- 


-“Robert M. Hutchins, The Conflict in Education in a Democratic Society (New York. 
Harper & Row, Publishers, 1953), pp. 78-79. 
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there could be an art of leaching, if art is used to mean the subtle practices 
which “succcssfur' teachers use. But to consider (caching as an art does not 
eliminate education from being a science. 


DESCRIPTIVE AND EXPLANATORY LEVELS 
OP SCIENCE 


Descriptive Level of Science 

One purpose of science is to c.xplain events or behavior. In any scientific 
undertaking, however, description and careful observation ordinarily precede 
explanation of the events. 

When the scientist describes what is going on in a classroom, he tries to 
point out essential characteristics and details of pupil-teacher behavior and 
of the classroom environment. This description may be molecular, noting the 
smallest details (such as physiological reactions or movements in response to 
specific stimuli), or it may be molar, deseribing larger and more encompassing 
acts (such as students raising their hands when the teacher asks a question). 

For example, suppose that we wish to describe the behavior of a child who 
is subjected to various degrees of frustration produced by withholding a 
variety of toys. At a molecular level, we might wish to measure such physio- 
logical reactions as blood pressure or galvanic skin responses, or we might 
be concerned with the specific movements which the child or the teacher 
make in response to various types of stimuli. If the intent of the research 
is to investigate physiological reactions to frustration, a molecular approach 
may be quite reasonable. If, however, we want to describe to teachers how 
children respond when frustrated, the description may consist of larger units 
of behavior such as “John cried” or “The children became aggressive.” This 
more molar level of description would be sufficient. 

There are consequences of becoming overly molecular or overly molar 
in describing behavior. An overly molecular description may provide more 
information than is needed to understand the problem. It requires an exces- 
sive amount of work accumulating data which may have little potential use. 
This would be similar to teaching pupils the concept of a book by describing 
every typographical mark contained in one. An overly molar description, on 
the other hand, may be vague. A statement such as “A book is composed of 
pages” does not describe a book with sufficient clarity to be useful. 

Description, whether molar or molecular, is always selective. The research- 
er must choose certain aspects of his environment to observe and disregard 
others. To a large extent his training should determine what will be selected 
for observation and what will be disregarded. To an untrained observer, an 
extremely obedient and quiet boy may appear to be the very epitome of the 
“good child.” To psychologically perceptive teachers, however, his behavior 
may be symptomatic of severe emotional problems. In a classroom, or m 
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mnlhcmalical models can be used to represent many empirical relationships. 
If tlic model is a physical object (i.c.. a picture, photograph, or miniature 
replica), it is called an iconic or replied model: if the model docs not physi- 
cally resemble its prototype but is used within a deductive framework to 
point out relationships, it is called a syinholic model. 

Models need be no more complex than their purpose demands. Political 
maps, for example, can be useful even though they may not be perfectly 
accurate; a model of the atom as a miniature solar system has proven itself 
useful even though the correspondence between them is by no means perfect. 
As long as we can reproduce the essential characteristics of a phenomenon, 
the model can be useful. What these essential characteristics are, of course, 
depends upon our purpose in constructing or developing the model. If we 
wish to predict the differential cfTccts of stress on a new type of airplane 
wing, the replica model should behave in the same way as the “real” one, 
and we may be willing to disregard such variables as color or comfort if they 
arc unrelated to our main purpose. Symbolic models, such as those based 
upon the normal curve or upon the algebra of straight lines, have relevance 
because they arc isomorphic with empirical relationships. 

Models help to explain phenomena by pointing out the essential similarities 
and differences between the model and its prototype in much the same way 
that analogies are used to explain complex ideas or relationships. Thus, 
for example, electronic computers have been used to form models for the 
human brain, to simulate large-scale management problems involving the 
deployment of personnel and equipment, and to estimate the consequences 
of decisions made by company executives. By using models to test hypotheses, 
savings in time, effort, and money can be realized. 

Explanatory models are of four different types. The deductive model 
takes the form of logical deduction. Given certain premises, certain conclu- 
sions necessarily must follow. If it is true that A = B and B = C, then A 
must be equal to C. The conclusion follows from a knowledge of the logical 
relationship between the three variables. Similarly, we can argue that if 
5^ = 25, then = 5, and 25'^^ = 5. It should be clear from our earlier 
discussion of deduction that the deductive model may be operative whether 
or not the premises are valid. 

A second type of explanatory model involves probability. John bites his 
nails, is nervous, has difficulty sleeping, perspires excessively, and cries a 
great deal ; a likely explanation for his behavior is that he belongs to a general 
class of individuals who, for one reason or another, are unable to adjust to 
the stress of modern living. With a probability model, John becomes a mem- 
ber of a general class of individuals (neurotics) about whom we have some 
information of a statistical nature. Thus, from empirical studies, we may 

-“Ernest Nagel, The Structure of Science (New York: Harcourt, Brace & World, Inc., 
1961 ). 
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a. Common scn^c may refer to '‘generally accepted but incorrect informa- 
tion." or to “generally accepted and empirically verified knowledge.” 
In the first definition the term is used to avoid presenting evidence for be- 
liefs; the second use of the term, while more defensible, is too often used 
as a rationalwation to end discussion. 

b. The appeal to authority is an attempt to “take someone clsc's word for 
It." rather than to investigate matters as carefully as possible for oneself. 
Four criteria for judging authorities were suggested ; 1 ) the authority must 
be identifiable; 2) he must be rccogni/cd as such by members of the profes- 
sion in svhich competency is claimed ; .'F) he must be living, or no new and 
rcicsant facts should have come to light since his death; and 4) he must not 
be biased. 

c. Intuitive beliefs arc “hunches" or “insights" into the relationships be- 

tween variables which suggest a course of action and which arc derived from 
one's past experiences witli similar phenomena. If put to the empirical 
lest, intuitions can be verified or disproxed. providing a check upon ones 
beliefs. In this way intuition is similar to the scientific hypothesis. Both test 
empirically the expected relationships between variables. If intuitive 
beliefs or feelings arc not verified or disproved empirically, they are not 
validated and can provide no justifiable basis for action but that of con- 
venience. „ 

Revelations arc beliefs or feelings claimed to be derived “supernaturally. 
The validity of private revelations is open to question, especially if they 
conflict with empirical observations. 

d. Rationalism is the belief that reason yields more reliable knowledge 
than docs revelation or experience. Rationalists emphasize deductive 
reasoning as a primary means of gaining knowledge. Thus, they woul 
argue that mathematics and logic provide more reliable information thnn 
does empiricism. Unfortunately, deductive reasoning often begins wi 

a major premise which is either tautologous or so specific that it holds on y 
for a limited number of cases. 


2. Several definitions of science were considered : it was described as a source 
of ultimate authority, a skill, an honorific, or an organized body of know ^ 
edge. Science is defined in this book as a method or attitude with the fo ow 
ing characteristics: .. . 

a. Reduction and control of bias. The scientist recognizes his fallibility an 
makes his observations in as objective a manner as possible. He is n 
however, without personal values, principles, prejudices, or 

b. The quest for precision. A distinction was made between 

desire for precision and accuracy and the quest for absolute or irretu a 
knowledge sometimes erroneously attributed to him. The scientist dep 
upon his tools, techniques, and methods to provide himself with 
edge, but he recognizes that this knowledge is open to question and ve 

c. Verification. Because the scientist is fallible, he must allow ot 
verify or disprove his conclusions. In turn, he examines evidence pro 
by other investigators. It was pointed out that verification is possi e 
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a classroom, which may involve highly complex skills, and accumulating 
knowledge about education, which requires other skills. 

5. Science is composed of both descriptions and explanations. Descriptions 
may be either molecular or molar, depending upon the purposes of the inves- 
tigation and the amount of information the researcher is willing or able to 
assimilate. Molecular descriptions are minute, detailed, and specific; molar 
descriptions are more general and encompass broader aspects of behavior. 

Explanations show how an event or phenomenon is related to a general 
law or principle. One way of explaining phenomena is to relate observations 
to a body of theory. Another way is to develop a model and show the rele- 
vance of the observation to the model. Four explanatory models were de- 
scribed: the deductive model involves drawing specific conclusions from 
premises, the probability model involves induction and prediction, the 
teleological model explains events in terms of purposes or goals, and the 
genetic model explains events by specifying their antecedent conditions. 


PRACTICE EXERCISES 


1. Each of the following statements might be considered by some persons as 
“perfectly obvious,” and therefore not in need of investigation. Indicate 
how certain you are that each statement is “correct.” If you are uncertain that 
it is correct, indicate what evidence you would need to determine the cor- 
rect answer. If you are certain the statement is correct, indicate the reasons for 
your belief. 

a. In a fourth-grade class, John is older than Mary, Mary is older than 
Peter, and Peter is older than Bill. Of the four children, Bill is the young- 
est. 

b. By lowering the pupil-teacher ratio, teachers will be able to do a better 
job of teaching than they are now able to do. 

c. Kindergarten teachers should have had children of their own to raise 
before they enter the teaching profession. 

d. The teacher should be a model citizen so the children will emulate him. 

e. Some children love their teachers. 

f. Schools are either elementary, junior high, high schools, or colleges. 

2. Indicate the difficulty (if any) in accepting each of the following persons 
or staternents as authoritative. If further information is needed, indicate what 
type of information you would require before you could evaluate the state- 
ment or person. 

a. Judge Jones, a member of the Supreme Court, states that the poor 
relationship between parents and children is the cause of juvenile delin- 
quency. 

b. The author of this textbook says that a distinction can be made between 
teaching as an art and education as a science. 

c. Admiral Rickover states that the schools in Europe are better than the 
schools in the United States. 

d. John Dewey says that values depend upon their consequences. 
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c. educational {-"iycliologists agree tliat motivation is important in 

Icaming. 

5. For each of tlic following examples, indicate the methods you could 
employ to either verify or reject the statement or question. Which statements 
or qucstion<- cannot he investigated? Why? 

a. How high i*- up? 

b. The principal of a -ichool ix rc*.pon<-iblc for its program. 

c. Tcaclicrs should be cqiially prepared in knowledge of subject matter 
and in mclhod<. of teaching. 

d. The kindergarten teacher should receive the same pay as the high school 
teacher if th.cy arc both equally %scll trained to do their jobs. 

c. Thc-c questions arc not difiicull. 

A. Indicate the underlying a<.'-umption^ for each of the following statements. 

a. The curriculum should be bn'.cd on the Great Rooks. 

b. John has an IQ of S-5. 

c. Children should be required to work in the cafeteria at school. 

d. Sooner or later science will answer all of the pressing educational 
problems. 

c. Reading is more important than playing. 

5. What theory could you develop that would help explain each of the follow- 
ing groups of facts? ,'\ssume that each of the facts is ‘‘true.*’ 

Fads for Group / 

a. At 6:00 a.m., John is awakened by a person talking to him very softly 
from the window of his room. 

b. The voice is so low that he cannot make out what the person is saying. 

c. There is no one in his room but himself. 

d. He runs outside but there is no one there. 

e. Each time he returns to the room he hears the voice again. 

Fads for Croup II 

a. Of 20 cats isolated from birth from all other animals, 9 were known to 
kill rodents. 

b. Of 21 cats who saw rodents being killed, 18 were known to kill. 

c. Of 18 cats reared with rodents, only 3 were known to kill. 

d. The cats’ diet (vegetarian or nonvegetarian) was unrelated to whether 
they killed or not.^® 

Fads for Group III 

a. Most of the world’s best-known persons have been males. 

b. More men than women have been in homes for the retarded. 

c. More men than women have been identified as gifted. 

Fads for Group IV 

a. Negroes who migrate to the North do as well on standardized tests as 
those who remain in the South. 

b. The average tested IQ for the Negro is 9 to 10 points lower than the 
average Caucasian’s. 


Y. Kuo, “The Genesis of the Cat’s Response to the Rat,” Journal of Comparative 
Psychology, XI, No. 1 (1930), 1-35. 
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c. Sonic Negro children have IQ's as high as 200. 

d. Northerners consistently score higher than Southerners of the same 
racial extraction. 

e. Caucasians score consistently higher than Negroes living in the same 
region. 

6. For each of the following theoretical positions, indicate what facts you 
would need to give credence to the theory. How could such facts be obtained? 

a. Theoretical Position I: Frustration leads to aggression. (Frustration- 
Aggression Theory) 

b. Theoretical Position II: For learning to occur there must be a reinforce- 
ment. (Theory of Reinforcement) 

c. Theoretical Position III: Much significant human behavior is uncon- 
sciously motivated. (Theory of Subconscious Motivation) 

d. Theoretical Position IV: Children are born bad. (Theory of Innate 
Depravity) 

7. Indicate what type of explanation is most called for in each of the follow- 
ing questions (deductive, probability, teleological, or genetic): 

a. Does John smoke because he has an oral fixation? 

b. Will that door open if I turn the handle to the right and push it? 

c. Did Columbus land in Santo Domingo in 1492? 

d. Why were schools built? 

e. Can safety belts help prevent injury? 

f. Why does times equal A'®? 

g. Why are the streets wet when it rains? 


SELECTED RELATED READINGS 


1. Feigl, Herbert, and May Brodbeck, Readings in the Philosophy of Sci- 
ence. New York: Appleton-Century-Crofts, 1953, 811 pages. A collec- 
tion of readings ranging widely in level of difficulty. Students will find 
the following selections most helpful in extending their knowledge of 
the meaning and assumptions underlying science: Pages 8-18 contain 
an excellent critique of misconceptions of science; advanced students 
may find selections on pages 47-102 concerning the meaning of verifi- 
ability to be of interest. The meaning of explanation in the sciences can 
be found on pages 319-352 and 688-743; concepts of causality and deter- 
minism are treated on pages 387-407. Of special importance to students 
of educational psychology is Section V, on “Philosophical Problems of 
Biology and Psychology,” pages 523-659. Pages 757-780 contain some 
excellent articles on “The Limits of Science,” “Causality and the Science 
of Human Behavior,” and “The Laws of Science and the Laws of Eth- 
ics.” 

2. Kaplan, Abraham, The Conduct of Inquiry. San Francisco: Chandler 
Publishing Company, 1964, 428 pages. Written by a philosopher, this 
text examines the philosophical assumptions underlying research in the 
behavioral sciences. 
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Larrabcc. HnroM A.. Rclichic Kt;owIcJ):c. CanibriJgc, Mass.; The River- 
side Prc^*-. 19-^5. 6S5 pages. .An cxccllciu introduction to the problems of 
obt.iining and c\ ablating reliable knowledge. Especially relevant material 
can be loiind m Chapter 2 (Man as Knower: From the Inside): Chapter 
3 (Formal bogie NMiat Follows from Premises); and Chapter 4 (Toward 
Scicniitic Method' Observation — “Get the Facts”). 

Nagel. Ernest. Ti:c Strurltirc of Science: Prohlc/ns in the Logic of Scien- 
tific l:\plor, anon. New ^■ork : Harcoiirt. brace sk: World. Inc., 1961. 
61S pages. .Students will lind the introduction, titled “Science and 
Common Sense." to be of interest. In addition. Chapter 2. “Patterns 
of Scicnlibc F.\planation." should c.vtend the present discussion of the 
role and meaning of explanation in the sciences. 



CHAPTER TWO 


The Role of Research 
in Education 


At the First Annual Phi Delta Kappa Symposium on Educational Research, 
the late Palmer Johnson observed, “In a population which is so dependent 
upon research, it is sad to reflect how few people perceive what it is all about. 
Research is an approach to a comprehension of the universe along a broad 
thoroughfare of organized knowledge solidly established on observation and 
experiment imbedded in a matrix of theory. It is a highway that is continuously 
being lengthened, widened, and mended.”^ 

However, Professor Johnson’s definition of research appeared overly ideal- 
istic to the editor of the Phi Delta Kappan, “a journal for the promotion of 
research, service, and leadership in education,” who stated, “That part of the 
research highway devoted to education is, it seems to us, in exceedingly poor 
repair, full of holes attributable to amateur workmanship, and breaking up 
entirely in spots because of bad engineering and faulty specifications.”^ 

These two quotes emphasize an increasing concern among educators when 
they discuss educational research. Such discussions are likely to extol the 
promise of research in general, at the same time admitting that, in education, 
the promise has not been entirely fulfilled. 

This paradox of extolling the promise of research while criticizing its 
accomplishments is based upon a misunderstanding of the nature of educa- 
tional research. Although Americans have long emphasized “Progress ... to 
be the first law of nature,”^ they have, at the same time, refused to state ex- 
plicitly the direction that progress ought to take. Inherent in this plea for 

'Palmer O. Johnson, “Introductory Remarks at Opening of the Symposium on Educa- 
tional Research,” in First Annual Phi Delta Kappa Symposium on Educational Research, 
ed. Frank W. Banghart (Bloomington, 111.: Phi Delta Kappa, Inc., 1960), p. xv. Italics 
added. 

^Stanley Elam, “What — and Where — is Educational Research?” Phi Delta Kappan, 
XLI, No. 6(1960), 241. 

^Vernon L. Parrington, The Romantic Revolution in America, Vol. II of Main Currents 
in American Thought (New York: Harcourt, Brace & World, Inc., 1954), p. ix. 
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procTC'-'^ !<- Ihc hclir!' rc^cnrch c.in provide, or .it '•iioiild provide, 
ihc Vnowlcdec r, reded to coniribittc to cdtie.rtional rcrornv^ .ind iinprovc- 
i"cn;>-. N^'hiTt li.T*- jrot been iiirdcr-'tood i‘« that research alone i*; unable to 
tmn'-form the 'ehoo!'- into I’ninrc I'topia*-. 

Palmer .lohn'.on wa*- correct ''•hen he 'lated. “Re'earcli ic an approach to 
thccomprchcn'-ion ol'tlte iini'cr'-c . . but rc'carcli i' not thco/i/vapproacli. 
and it i' not .i pan.rcea for ail educational problem'. CItanec' in education 
Ita'c resulted from and contributed to ni.iny divcr'C social, economic, and 
political conditions. Research does not c\ist m a 'acuum unalTcctcd by the 
hopes, aspir.iijons. and limitations of the rest of society. Considering the 
fallibility of research rnuimgs and remembering that these t'mdmgs must be 
evaluated in the light of local economic, political, social, and aesthetic beliefs 
and practices, it sliould be clear that any given research finding cannot expect 
immediate acceptance and implementation in all schools throughout the 
nation. What ma,' be a reasonable "ay of dealing "ith a problem in one com- 
munity may not be dcsir.ddc or feasible in another. Thus, although research 
may provide hno"lcdge about empirical relationships, educators may very 
"cll refuse to implement these findings if. for example, the implementation 
might lead to economic or social injustice. 


Typi:s or REsrARCii acti\'ities and 

THEIR RELATIONSHIP TO EDUCATIONAL 
CHANGE 

A distinction may be made between hcisiv rcsctirch, whose purpose is to 
develop a body of theoretical knowledge, and applied research, which is 
designed to answer questions having immediate applicability. The desire to 
produce innovations usually calls for some form of applied research. Later 
in this chapter we will show that there is a reciprocal relationship between 
basic and applied research and that they arc neither antagonistic nor mutu- 
ally exclusive. However, basic research lias too often been neglected and 
overlooked by those intent upon improving educational practice. Because 
theory suggests which facts are relevant and necessary to the understanding 
of a problem, the researcher working outside of a theoretical framework 
may have only vague principles to guide him in his selection of variables to 
investigate. Lfnless there is a background of theory and empirical research 
to back up some proposed educational innovation, it may be necessary to 
evaluate every whim and fad in the public schools to see if they will work. 

Unfortunately, this is exactly what has happened in education. Instead 
of first becoming concerned with the development of a broad body of theoret- 
ical knowledge, much educational research simply attempts to compare 
method A with method B. It is little wonder that educators have become 
disillusioned about the practical benefits derivable from research when they 
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realize lliat tlicrc arc an infinite number of methods which ultimately could 
be compared. To discover that /t is superior to li tells us nothing about how 
A will compare with C, D, E, etc. Theory and empirical research may help 
specify the relationships between these methods so that their common attri- 
butes can be investigated and their diircrcnccs evaluated. 

Many of the recent innovations in science and mathematics curricula 
were developed without previous empirical investigations to back up the 
claims made for them by their innovators. Empirical studies arc needed to 
help develop theory as well as to validate rudimentary theoretical positions. 
Today, we have literally hundreds of specific suggestions for teaching arith- 
metic, ranging from workbooks to Cuisinairc blocks to the currently popular 
University of Illinois Committee on School Mathematics (UlCSM) curric- 
ulum. These techniques arc being used in schools without sufficient evidence 
to suggest under what conditions and for what types of students they can be 
used most effectively. As one researcher pul it: 

Ideas spring from the innovator’s mind into direct application to children 
and teachers with no intermediate steps. If medicine did things the way we 
do, the Salk vaccine would have been administered to everyone merely 
because Jonas Salk thought it should be, and was persuasive enough to get us 
to do it. . . . We should adopt the point of view that ideas should not be 
tried on children until there is some large amount of evidence that the ideas 
are workable and the results will be beneficial.^ 

Behind the statement that innovators should be concerned with research 
is the principle that one should not try to implement what is not known. 
Even in the marketing of a new detergent, the way chemicals react on materi- 
als must be known before the product is sold to the public. What we have in 
education is a lack of knowledge coupled with thousands of suggestions on 
how to do a better job. We need to know what to expect of any innovation 
before it can be recommended. 

Although basic research is necessary, by itself it is not sufficient to justify 
the use of any proposed innovation. Field tryouts are needed to evaluate the 
practical effects of the innovation. It may turn out, for example, that a new 
teaching approach has much to recommend it theoretically but is so expensive 
to implement that it would be unworkable under present conditions. The 
responsibility of development and demonstration is to make proposed changes 
practicable. 

Development as an impetus to innovation 

Development includes those activities used to lower costs and increase the 
efficiency of products, practices, or conditions in order to promote their 
greater usage. In industry, for example, the responsibility of development is 
to take a product which has been shown to have value and produce it effi- 

^Daniel E. Griffiiths, Research in Educational Administration: An Appraisal and A Plon 
(New York: Bureau of Publications, Teachers College, Columbia University, 1959), p- 5 • 
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inc\per.'-i\ c. bi:i it i<- »!p ti' the dernimsif.itnMi to show teachers and admini- 
strators that i;-,e aprr*Tae)i is (ipcraliona.IK tisefiil aiul desiralde; unless it lias 
some appeal wlncii can I'e liemonstr.itcd. it is unlikely to fiiui its uay into very 
many classrt'oms. As ilie innov.ifimi is lienionstrated, new problems for 
rcsearcli and development tna.v be rcncr.itcvl. 

TYPES Of RESEARCH 

AS I) THEIR REI.ATIOSSIHR TO ISSO\'ATION 

Development and demonstratii>n depend upon having reliable knowl- 
edge concerning a proposed innovation. Tfiis knowledge can be derived Irom 
the application of various research methods; analytic, descriptive, and e.\- 
perimental (see Table I). 

Analytic Research 

A number of related research activities may be subsumed under the head- 
ing of analytic research. This includes mathematical, linguistic, historical, 
and philosophical analyses, as well as any primarily deductive .system that 
can be used to derive relationships not ncce.ssarily of an empirical nature. 
Examples of analytic research include the analysis of data through statisti- 
cal procedures, the analysis of language through grammar and linguistics, 
and the analysis of assumptions and implications through logical and philo- 
sophical procedures. 

Analytic research helps point out the assumptions and possible conse- 
quences of proposed innovations. The historian, for example, may be in a posi- 
tion to show how a proposed change is related to some historical event that 
has already been tried and evaluated. Analysis may also be used to help 
establish criteria for the evaluation of an innovation. 

One form of analytic research is data retrieval. Its purpose is to gather 
information from both primary and secondary sources. A primary source is 
one which has direct access to an original observation. For example, an origi- 
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nal manuscript or a report from an c>c\’. Kiic^'- arc primary sources of infor- 
mation. In contrast, a secondars source is one or more limes removed front 
the original observation. A report fmm a second-hand witness or a book 
which summarises the contents of oncmal icports arc secondary sources. 

By searching tlic literature, the investigator concerned with innovation 
can take advantage of the experiences of others engaged in related pursuits. 


Type.s or RrsrAucH and Tiiiiu 


Aitalviic 

Purpose To derive relation- 

ships within a deduc- 
tive system 

Methods Deductive, mathe- 

matical, historical, 
philosophical, legal, 
linguistic 


Relation Points out assump- 

to tions and possible 

Innovation consequences of pro- 

posed changes: use- 
ful in establishing 
criteria 


TMtII I 

Rll Vllre^silir TO rDt r.VTinSAt, INNOVATION 


Dr'.ct iptnr 
To describe existing 
conditions 


Experimental 

To test causal rela- 
tionships 


Correlations, surveys, 
case stiiilies. direct 
observation. cross 
ciiliiiral. growth stu- 
dies 

Describes currently 
existing conditions 
so that they can be 
modified later 


Comparison of W' 
acrimcntal and non- 
:\pcrimcntal groups 
by systematically 
varying conditions 
Shows the effects of 
1 proposed innova- 
tion 


Data retrieval allows the investigator to analyze the relationship between his 
studies and those of other researchers. It may point out weaknesses in his ap- 
proach, or help him find a body of related studies to form the basis of 
theory, thus leading him to select variables for study which can be justified on 
the basis of prior evidence. 


Descriptive Research 

The purpose of descriptive research is to show conditions as they 
wit out emg influenced by the investigator. Descriptive research enconi 
passes a number of different techniques, including correlational analyses, 
case studies, surveys, and interviews, as well as direct observation. Thes 
techniques will be discussed in greater detail in later chapters. . 

escrip ive research is often of greatest value during the initial stages 
an inves igation. If the current status of a problem is described, steps may be 
taken la er to remedy it. If, for example, educators are concerned about th 
effects that high school dropouts are likely to have on the economy, a firs 
step might be a study to determine how many students leave high school 
before graduating, what occupations they move into, their salaries, em 
Descriptive research may also help point out the extent of a problem and 
indicate how serious and widespread it is. Once this information is available, 
the scientist can begin to resolve the problem 
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Oi I ;uu'n;,7f rcsciirc/t is to study “causal" relationships, 
tor cv.’iripic. to ''tiuly tiic cllccls rewards have on learning or 
.rd\aniace‘. ot one method of teaching over another. The 


in\c''lic,iior trie'' to control (i.c.. eliminate or hold constant) the effects of 
cvtr.rncou'. condith->nv in order to study interactions between variables. 

Rcc.'hoc ilic esperiment '•tiidics causal relationships, the elfect of any pro- 
po'^cd inno\ ation in education is most ajrpropriately evaluated by using some 
form of experimental design (see Chapter Twelve). 

The role of the experiment itt “iolving the school dropout problem might be 
to determine w hicii ol x arioiis proposals to retain students leads to the largest 
number graduated. These projiosals might include the establishment of a 
work-study combination program xxhere the student works half day and at- 
tends school half da} : or they might involve an evaluation of the “job eorps,” 
the use of volunteers to help motivate students planning to drop out of school, 
etc. Before deciding which proposals will be evaluated, answers are needed 
to such questions as; “What is the relationship between social class and 
opportunity for success in the public schools?" “How docs the reward struc- 
ture in schools afiect achievement?" “Under what conditions and at what 
ages do negative attitudes toward .school begin?” “What factors are most 
responsible for motivating students to achieve and enjoy school?” Unless 
these and other related questions arc investigated, an experimental program 
designed to test one method of reducing dropouts against another is not 
likely to be very successful. 


THE HISTORICAL DEVELOPMENT 
OE EDUCATIONAL RESEARCH 

One reason educators have emphasized the values of research is that it has 
contributed information needed to implement and evaluate educational 
practices. The educator, like other professionals, depends upon having 
sufficient information about his work to act responsibly; it is in the process 
of obtaining and disseminating this knowledge that research is created. 

Prior to the twentieth century, which heralded the beginning of scientific 
and experimental education, information concerning the curriculum, teacher 
training, and student growth was based upon the prevailing philosophical 
beliefs of the time as well as upon the biases of individual educational prac- 
titioners. These beliefs went unchallenged until the effects of the technological 
revolution were felt in the public schools. Technological advances forced 
the'twentieth-century educator to find new ways to cope with the millions of 
children brought into the public schools by compulsory education laws. He 
not only had to contend with a greater number of students, but he had to find 
ways to modify the curriculum so that it could accommodate the ever-increas- 
ing list of required subjects forced into it by technological advances. 
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The scientific niovcmciU in education developed out of the need to justify 
and improve upon existing educational beliefs and practices, and not from a 
desire to develop a new social science which might parenthetically contribute 
to educational change.’ The educator of the early I900’s (like his modern 
counterpart) was too busy with practical matters to devote much of his time 
or attention to founding a science of education, unless that science could have 
immediate utility. This need for immediate “solutions” led to literally thou- 
sands of research activities, with few of them contributing to or derived from 
theory. Thus, although today we have a great many research studies in 
education, to a large extent they arc not organized into theoretical systems 
which account for and explain empirical relationships. 


The Early Beginnings of Educational Research 

Although it is most difficult to determine exactly when the scientific move- 
ment in education began, the writingsofJohann Friedrich Herbart(1776-1841) 
may be taken as the first major impetus to the scientific study of education. 
At Konigsberg, where he was a professor of philosophy, Herbart offered a 
seminar in education and suggested that the scientific study of education was 
possible. However, his contributions to education were not widely acclaimed 
until 1895, when the National Herbart Society was founded in the United 
States. Later, this organization changed its name and became the National 
Society for the Scientific Study of Education. Jn 1910 it became known as 
the National Society for the Study of Education (NSSE), which today pro- 
vides scholarly yearbooks on a variety of subjects related to education. 

Another impetus to the scientific study of education began with the estab- 
lishment by Wilhelm Max Wundt at Leipzig in 1 879 of the first psychological 
laboratory. Although Herbart had refused to believe that experimentation 
was possible in education (he did claim that psychology was both empirical 
and mathematical), Wundt established laboratory experimentation as a major 
research tool. 

Wundt’s experimental laboratory had its American counterparts in Wil- 
liam James’s laboratory at Harvard in 1875 and in G. Stanley Hall’s labora- 
tory at Johns Hopkins University in 1883. James’s Talks to Teachers, pub- 
lished in 1899, related principles of psychology to problems faced by edu- 
cators. Hall has been credited with founding of the child study movement in 
America. In an attempt to discover the “content of children’s minds, he 
popularized the use of the questionnaire, a technique developed by Sir 
Francis Galton in 1883. By 1891, Hall was able to found Pedagogical Semi- 
nary. The establishment of this journal was evidence that educators had 
begun to feel the need to communicate with each other concerning the attain- 
ment of knowledge in child growth and development. 


^H. G. Good, A History of American Education (New York: The Macmillan Company, 
Publishers, 2nd Ed., 1962), p. 415. 
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The diolojv oi'lh.c c.uU <.troii!:l> fell the itilliiciiec of D.invinisni, 
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be I'tndicd by n.itnr.ili'.iie ob^cf\ .ition nnd tli.it he obc>ed the same I.nvs ;i<; 
did other member'- of the .immai Kinedom. 'riiirtcen years later, in iS72. 
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he pointed out that facial esprc'-'-ioti'- were cnrsival'. of various habits related 
to the continuance of the species. He also suimested that the o\crl display of 
an emotion tsuch as lo\e) could be used to hide its emotional opposite, Inite. 
By 1915. Freud maile use of this concept to show how rcuctio/i formations 
could be used as a subconscious eco-protectne mechanism. 

.Sir Francis Galton. Charles n.irwin’s cousin, was greatly influenced by 
him. Galton was interested primaril> in eugenics and the study of individual 
differences. His snuhcs led him to deielop a number of rather crude and 
simple reaction-time and association tests. In 1.S.S2. he was given space in the 
South Kensington Museum to test, for a small fee. those persons interested 
in hav ing their abilities measured. He thus established the first testing center, 
and became, in effect, the first psvehometrist. Six years later, in bSSS. he 
published a mathematical procedure for describing the degree of correlation 
between two variables. 

The scientific movement in education was furthered by James McKcen 
Caltell. who had worked with Wundt at Leipzig, G. Stanley Hall at Johns 
Hopkins, and Galton in London. In 1890, Cattell used the term mental rests 
in print for the first lime, and five years later he was able to persuade the 
American Psychological Associtition to evaluate the use of tests in education. 
Cattell also developed a psychological laboratory at Columbia which encour- 
aged additional investigations into individual differences. 

Edward Lee Thorndike, often credited with being the “father of educa- 
tional psychology,” was CattcIFs student at Columbia and James’s at 
Harvard. In 1898, Thorndike published Animal Intelligence, which showed 
how animals could be used in a laboratory situation to study intelligence 
as well as the learning process. The publication in 1904 of his Theory of 
Mental and Social Measurements made him a respected leader both in learn- 
ing theory and in educational and psychological measurements. 

The measurement movement provided fertile ground for two types of re- 
search. First, there were a number of immediate and practical needs requir- 
ing the use of tests. In France, for example, compulsory education laws 
forced many children who had not attended school before to enter the public 
schools. Many of these children were so retarded intellectually that ways had 
to be found to separate them for special classes. Binet and Simon undertook 
the task of developing a test that could be used for differentiating pupils into 
regular and special classes. Their first practical scale was devised in 1905. 
With the development of this scale, many other practical uses for tests were 
found. By World War I, mental measurement experts were well accepted 
in both schools and industry. 
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Second. (cs(s could be used to help develop theories about the nature of 
intelligence or personality. In 1902, for example, Thorndike suggested a 
multifactor theory of intelligence. Intelligence, he argued, was composed of 
linguistic, mechanical, and social factors or abilities. Two years later, Spear- 
man devised a method called /oc/or analysis for analyzing complex batteries 
of tests; he hypothesized a two-factor theory of intelligence. According to this 
theory, intelligence could be described by a g (general) factor and s (specific) 
factors. The Thorndike-Spearman controversy was important because it 
pointed out the need for systematic theories of intelligence and for more 
sophisticated ways of analyzing tests. In 1938, Thurstone showed that intel- 
ligence could be analyzed into a number of primary mental abilities', he thus 
supported Thorndike's earlier contention that intelligence was not a unitary 
trait. 

Knowledge about the learning process began with the studies of Hermann 
Ebbinghaus in 1885. By memorizing lists of nonsense syllables (bej, fup, 
hif), he plotted his own learning curves and compared them with curves 
obtained by memorizing meaningful information. From these comparisons 
and from other investigations, he showed the advantages of distributed over 
massed practice and of the whole method of learning over the part method. 
The Bryan and Harter experiment on the acquisition of skills needed to learn 
telegraphy (1897) furthered Ebbinghaus’ work. Bryan and Harter were able 
to describe “typical” learning curves and to suggest various reasons for 
plateaus, or trials where little progress was made. 

However important the Ebbinghaus and Bryan and Harter investigations 
were, Thorndike’s Connectionism is generally credited with being the first 
major theoretical position on learning. Thorndike provided evidence that 
learning could be facilitated by the application of various “laws,” such as 
the law of effect (learning is facilitated if it is followed by a state of satisfac- 
tion and hindered if followed by a state of dissatisfaction). His experimental 
work encouraged his students and colleagues to develop their own modifi- 
cations and improvements on his original system. Pavlov, for example, knew 
about Thorndike’s studies of animal learning at the time he was working on 
conditioned reflexes and gave credit to him for his early research on animal 
learning. 

The Rise of the Psychological “Schools” 

Wundt’s experimental laboratory at Leipzig attempted to study the contents 
of the mind, through introspection and experimentation. This was a reaction 
against the type of armchair philosophy which had become associated with 
psychology in its early development. The new psychology, called structural- 
ism, accepted the following premises: 1) psychology can be investigated scien- 
tifically; 2) psychology is defined as the study of mental contents; 3) mental 
contents can best be investigated through introspection or the careful analysis 
of one’s own sensations and perceptions in response to specific stimuli; and 
4) complex experiences can be analyzed into simpler ones. 
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Strnciur.ils^Tri i'cHini u.iy to the I'nitcd States uitii one of Wundt's stu- 
denf-. rdv'.ard Titchcncr. wlio directed (he psychological laboratory at Cor- 
nell !int!l hi<i death, in 'Ncrecing with Wundt on the purpose and methods 
to be toed b> p'>ch.o!ogi<.(>.. he rebelled against the then-current school of 
/.vr:r.';cr:.;, Jed b> Joint Dewey and James Rowland Angcll. Instead of 
dc>-cribing the content of the mind, functionalists studied its functions. That 
is. they were more interested in the purpose and uses of intellect than in 
ways intellect might be structured. 

The battle between structuralism and functionalism had important re- 
percussions for education. If mind were structured, one responsibility of the 
educator would be to discoccr what Kind of mental structure children have. 
In contrast, the functionalist was more concerned with purpose, or means- 
end relationships. He diti not asK what structures the mind was composed of, 
but how intellect functions and what it might be expected to do. 

••Mlhough Dewey was trained as a philosopher, he had become influenced 
by G. Stanley Hall, and was elected president of the American Psychological 
Association in IS97. In 1902 he became the director of the School of Educa- 
tion at the I'niversity of Chicagc>: in 1904 he went to Teachers College, where 
he remained as professor of philosophy until he retired in 1931. 

Dewey’s 1^96 paper. "The Reflex .Arc Concept in Psychology," showed 
his dissatisfaction with structurtdism. In this paper, he gave an example of 
a child who sees a flame, retiches for it. and gets burned. Dewey argued that 
it was necessary to consider the entire act as a continuous one, and that the 
separate elements of perception, movement, and sensation have no meaning 
by themselves. One cannot separate the elements of an act from its conse- 
quences or purpose. Essentially, this meant that Dewey did not consider valid 
many of the dualisms psychology had inherited from Descartes. Thus, he 
eliminated such dichotomies as those between mind and body, method and 
content, or ends and means. These conceptions eventually led him to write 
Democracy and Education in 1916 and Experience and Education in 1938. 
These texts provided the basic tenets of progressive education. 

James Rowland Angell was brought to the University of Chicago by Dewey 
in 1894 and became its president 24 years later. In 1906 he was elected presi- 
dent of the American Psychological Association; his presidential address was 
titled “The Province of Functional Psychology.” At Chicago, Angell devel- 
oped a strong department of psychology dedicated to the principal tenets 
of functionalism. 

A third psychological school was Behaviorism, which developed in opposi- 
tion to structuralism and functionalism. It opposed structuralism on the 
grounds that psychology should not concern itself with consciousness or 
introspection; it opposed functionalism by stating that the proper subject 
matter of psychology was the study of behavior, not mental functions. While 
structuralists were not opposed to the study of behavior, they argued that 
this subject was biology and not psychology. 

Certainly the best known and most influential of the early behaviorists was 
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John Watson, who received his doctorate in psychology from the University 
of Chicago in 1903, just one year before Dewey left Chicago for Teachers 
College. Watson was interested in animal studies and could not see the appli- 
cation of introspection or thc analysis of consciousness to his work. Since 
both structuralism and functionalism depended at least in part on these 
methods, Watson became increasingly dissatisfied with both, and in 1913 he 
formally founded a new school by publishing a paper titled “Psychology as 
the Bchaviorist Views It." The purpose of all sciences, he argued, was predic- 
tion and control, and thc appropriate subject matter of psychology was 
behavior. Thc study of consciousness was unscientific and therefore was not 
to be considered a part of psychology. 

Watsonian behaviorism had a number of important implications for educa- 
tion. If, for example, the purpose of psychology is to control behavior, teachers 
might be able to develop ways of controlling the behavior of children in the 
classroom. To accomplish this, the child’s environment would have to be 
structured and to be controlled, not only in school, but at home as well. 
Learning could be controlled by means of the conditioned response; the 
teacher would have control over the stimulus. Because of Watson’s insist- 
ence that psychology could be useful, some applied areas of psychology re- 
ceived an important impetus. 

Watson denied the concept of “innate intelligence.” Intelligence, he be- 
lieved, was acquired in early childhood. This belief led him to study the devel- 
opment of emotions and how they might be modified through conditioning. 
Only three emotions could be found in infants — rage, fear, and love. Rage 
could be produced by restricting bodily movements, fear was induced by 
loud noises or loss of support, and love was demonstrated in the smiling and 
cooing response to tactile skin stimulation. Watson was so certain that 
heredity played essentially no role in determining behavior that, in 1925, he 
made his famous challenge ; 

Give me a dozen healthy infants, well-formed, and my own specified 
world to bring them up in and I’ll guarantee to take any one at random and 
train him to become any type of specialist I might select — doctor, lawyer, 
artist, merchant-chief and, yes, even beggar-man and thief, regardless of 
his talents, penchants, tendencies, abilities, vocations, and race of his ances- 
tors.® 

Although his challenge was never accepted, educators saw in it the un- 
limited possibility of training pupils for whatever objectives they had in mind. 
One of the most practical consequences of this point of view was the develop- 
ment by Pressey in 1924 of the teaching machine, which presented stimuli 
in the form of carefully constructed lessons or programs that would reinforce 
the learner if he responded correctly to the questions. Later, in 1953, Skinner 
published Science and Human Behavior, in which he showed not only how the 

®John B. Watson, Behaviorism (New York: W. W. Norton & Company, Inc., Publishers, 
1926), p. 82. Copyright 1925 by The People’s Institute Publishing Company, Inc., an 
1953 by John B. Watson. 
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away from an excessive dependence on the role of memory and drill, educa- 
tors eagerly embraced (he Gestalt movement as a panacea for many of their 
problems. However, most American psychologists considered themselves 
to be bchavioristically oriented, and they dominated the research scene in the 
behavioral sciences. The resvilt was (hat relatively little research on learning 
was done using Gestalt principles. In recent years, the cognitive theorists 
have done much to bridge the gap that existed for many years between be- 
haviorists and Gestaitisls. 

T\\q. psychoanalytic school owes its origins to Sigmund Freud. Although G. 
Stanley Hall is usually credited with being the “father of child psychology,” 
it was Freud who provided (he most comprehensive theory of child behavior. 
Psychoanalytic theory developed out of Freud’s experiences in working with 
neurotics. According to Freud, all behavior is motivated, sometimes con- 
sciously and sometimes subconsciously. Man, he said, is not always aware 
of his reasons for acting as he does; he may repress the reasons for his 
behavior. Repression was considered to be an ego-protective mechanism, 
along with sublimation, identification, compensation, etc. 

Freud argued that the purpose of education was to teach the child to con- 
strain his “natural instincts.” To do this, the school has to provide ways for 
the child to sublimate his aggressive and destructive tendencies. It cannot 
simply constrain or control him, because this can lead to neurosis. Freud 
believed that the “ideal” form of education could teach the child to curb his 
own antisocial tendencies without creating neuroses. 

The psychoanalytic movement depended heavily on case studies or com- 
prehensive descriptions of the individual’s past experiences to explain present 
behavior. Behaviorists, in general, could agree with this point of view easily 
by arguing that the totality of one’s present behavior is a combination of his 
earlier experiences. But to the Gestaltists, this was too much like arguing that 
a person is simply the sum of his individual experiences, since they believed 
that the whole was different from the parts. 

The Dissolution of the Psychological Schools 

The psychological schools arose to challenge the prevailing orthodoxy. 
The functionalists organized as a protest against the structuralists and in turn 
were attacked by behaviorists and Gestaltists. As each school developed, it 
created its own research methods to fit in with its philosophic orientation. 
Thus, introspective methods were considered absolutely necessary by Titche- 
ner; for Watson, only the objective description of stimulus-response relation- 
ships would do. Case history methods were of primary importance to the 
psychoanalysts, but were opposed by the Gestaltists. By developing its own 
methods and techniques, each school made its contribution to the studies of 
education and psychology. 

The psychological schools were largely the products of a few individuals. 
Wundt and Titchener for the structuralists; Dewey and Angell for the func- 



Nonet lieic'-''. to '-omc extent, one can (hul traces of all of these psychological 
schools still present in the writings of modern psychologists and educators. 
\\'hilc practicalh no one is willing to call himself an introspectionist any more 
(it is considered to be too “mentalistic”), verbal descriptions of experiences 
still play a most important role in modern research. Questionnaires, for 
example, depend upon having subjects respond to questions about their 
beliefs or attitudes, and thus are a form of introspection. The functionalists 
stressed the use of tests to measure the purposes and uses of intellect, and the 
psychoanalysts used the case history methods. Each of these techniques will 
be described in greater detail throughout the remainder of this text. 

Research in Educational Administration 

The problems of organizing, financing, and operating public schools are 
complex. Before the twentieth century, empirical research in educational 
administration was almost nonexistent, since the impact of scientific method, 
especially in the development of psychological tests, had not yet been felt. 
Nineteenth-century administrators developed their methods by depending 
upon a priori value judgments and what was considered to be common sense. 
Wundt’s admonition that a priori ist garnichts (unempirical claims are mean- 
ingless) had little effect on the development of educational administration. 

The motivation to investigate administrative problems empirically came 
from two sources: industrialization and the need for reform.'^ Industrializa- 


’Raymond E. Callahan and H. Warren Button, “Historical Change in the Role of Man 
in the Organization: 1865-1950,” Behavioral Science and Educational Administration, 
63rd NSSE Yearbook, Part 2 (Chicago: University of Chicago Press, 1964), pp. 73-92. 
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(ion and large-scale business operations had penetrated into almost every 
aspect of American economic life by the early 1900’s and had strongly 
influenced American values and practices in general. Along with these changes 
in values came the demand for greater reform and efficiency in public school 
operations. Unfortunately, school administrators were not in a position to 
cope with many of the practical problems brought about by compulsory 
education laws, increased enrollments, and the demand for economy. If busi- 
nesses could operate efficiently and economically, the public could see no 
reason for school administrators to do less well. Faced with the necessity of 
increasing school services while reducing costs, administrators looked to 
research to resolve their problems. What they meant by research, however, 
did not include theory. If there was to be any research, it would have to be 
judged by the extent to which it could reduce public criticism and increase 
school efficiency. Theory might be tolerated, but not demanded. 

The school district reorganization movement is a case in point. The idea of 
consolidating small, inefficient, and relatively expensive school districts into 
larger, more economical ones was suggested as early as 1837 by Horace 
Mann, but empirical research methods didn’t find their way into educational 
administration until 1910. In that year, Calvin N. Kendall, the Superinten- 
dent of Schools in Indianapolis, Indiana, surveyed the Boise, Idaho, school 
system. The school survey is a type of descriptive research which utilizes 
statistics on school trends in enrollments, salaries, space utilization, curric- 
ulum, etc., in order to implement recommendations leading to more effi- 
ciently operated schools. With the development of the school survey, it was 
possible to relate size of organizational unit with cost per pupil instructed. 
Publications by the United States Office of Education® and the National Edu- 
cation Association® presented data necessary to understand how school dis- 
tricts are organized and why small schools are unable to have a wide variety 
of programs and curricular offerings.^® 

Research was used to understand the relationship between reorganization 
and finance problems involving political and legal statutes, and the sociologi- 
cal effects that reorganization would have on the local community.^^ It was 
also used to evaluate the effects of school district reorganization. Studies were 
conducted to evaluate the effects of district consolidation on educational 
opportunities, academic achievement, social and personal behavior of children, 
the financial structure of states and districts, and the community itself.^® 


®Walter H. Gaumnitz, Small Schools are Growing Larger, U. S. Department of Health, 
Education, and Welfare, Office of Education, Circular No. 60J (Washington, D. C.: 
Superintendent of Documents, U.S. Government Printing Office, Sept. 1959). 

°M. C. S. Noble and H. A. Dawson, A Handbook on Rural Education (Washington, 
D. C.; Department of Rural Education, National Education Association, 1961). 

^Research Division of the National Education Association, “Subjects in Small High 
Schools,” NEA Research Bulletin, XL, No. 2 (1962), 56-58. „ d • nf 

"Burton W. Kreitlow, “Organizational Patterns: Local School Districts, Review J 
Educational Research, XXXI, No. 4 (1961), 382-384. 
i^Kreitlow, “Organizational Patterns,” pp. 384-388. 
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AhhoDch iTiO'-t ofJl'.c^c 'Uu1ic<.did provide c\ idcncc in favor of (he rcorran- 
i^niion n'ovcmcnl. !l;cy did not conSribntc snl’<-tantially to a theory ofcdiiea- 
tional adn'iini'-'ration. Ti'in'.. uiiilc a ercat deal of ciTort u as expended in rcsolv- 
inc an immediate problem, it xvas expended primarily to jiistity a proposed 
reform and not to contribute to an ttndersiatuliiu: of administratnc orpanira- 
tion tlirouch basic researcli. Grillith. himselfan ailministrator. has been partic- 
ularly critical of this txpe of administrative research: 

\\'r.ho;!: doubt, tb.c prc.itcst weakness of research in educational admmi- 
sination is tlic I.tcI. of tb,cor>. Most studies in educational administration 
arc done at tb.c !c\cl of "n,iV,cd empiricism." Hy tins uc mean that the rc.scarch- 
cr h.as an idea that a xapncly defined problem needs to be sohed. He 
collects data throuph a questionnaire, siirxey. or some other method and 
attempts to find an ansucr by "looKmp at the data." Hy folloump thi.s 
procedure sve base amas>.cd tons of data, but haxc come up uitli scry few 
answers.'’ 

It was the period follossma the close of World War II that marked the 
inception of thcorx into educational administration. Prior to that time, what 
little administratis c theors existed was largely the work of politieal scientists, 
manacement cxccuiiscs. engineers, and industrial researchers. But in 1946 
and 1947, there were three esents in education that helped clear the way 
for theoretical research.*’ b'lrst, the Kellogg Foundation’s education advisory 
committee recommended that the Foundation sponsor research into the study 
and improvement of educational administration. Second, the American Asso- 
ciation of School .Administrators (AASA) included the professionalization 
of the school superintendency in its objectives for the Association. And 
third, professors of educational administration founded the National Confer- 
ence of Professors of Educational Administration (NCPEA). 

In 1950, the Kellogg Foundation instituted its Cooperative Programs in 
Educational Administration (CPEA) in five major universities. A year later 
three more universities w'crc added. These centers helped attract scholars 
from other disciplines to study educational administration and encouraged 
capable graduate students to enter the program. While these centers did not 
convert educational administration into scientific laboratories, they did 
encourage a scientific approach to the study of administrative problems. In 
1955, the Kellogg Foundation supported the University Council for Educa- 
tional Administration. This organization consisted of the original eight uni- 
versities involved in the CPEA, plus other universities offering doctoral work 
in school administration. Its purpose was to conduct cooperative research on 
administrative problems, as well as to conduct scholarly seminars, publish 
case studies, and disseminate papers on important subjects. 

In addition to the Kellogg Foundation, the AASA has exerted a powerful 


■^Griffiths, Research in Educational Administration, p. 16. 

**Hollis A. Moore, “The Ferment in School Administration,” Behavioral Science and 
Educational Administration, 63rd NSSE Yearbook, Part 2 (Chicago: University of Chicago 
Press, 1964) p. 15. 
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influence on ihc (raining of adniinistralivc personnel. This group, composed 
of superintendents and assistant superintendents, was discontented with 
collcgc-lcvcl training programs in administration. In 1947, it requested 
S75.000 from (he Kellogg foundation to study (he role and training of school 
superintendents. Although (his proposal was rejected by the Foundation, 
it agreed to the development of the CPFA. 

T he third major contribution to (he change of character in administration 
was the formation of the NCPFA. This organization developed in 1947 out 
of a meeting of the AASA. and provided a means whereby college professors 
in administration could voice (he need for basic research. In 1957 it published 
Aclniiinstralirc lidtavior in /uliication, edited by Roald F. Campbell and 
Russell T. Gregg, which pointed clearly to (he scientific road which educa- 
tional administration could take. The Midsvest Administration Center at the 
University of Chicago has also taken a leading role in developing a science 
of administration. 


Research on Teaching Mctliods and the Curriculum 


Empirical research involving analysis and evaluation of the elementary and 
secondary curriculum, like research on educational administration, was 
practically nonexistent before the twentieth century. Only after suitable 
research tools, techniques, and methods had evolved was it possible to scruti- 
nize the assumptions that were generally accepted by nineteenth-century 
schoolmen. These assumptions concerned the nature of the learner, the 
characteristics of learning, and the objectives which were to be learned. 

The teaching methods of the nineteenth century emphasized the role of 
memorization in the learning process. Combined with the concept of formal 
discipline, the memoriter system demanded that all students learn difficult 
subjects in order to “train the mind like a muscle.” The result was a sterile, 
frustrating, and ineffective curriculum for a majority of the pupils. 

The motivation to improve learning conditions did not originate with the 
researchers but with the general public. As Jong as the schools emphasized 
the value of memorization and insisted upon teaching “hard” subjects to 
“exercise the mind,” teachers found it necessary to fail large numbers of stu- 
dents who were either unwilling or unable to profit by the instruction. This 
state of affairs was intolerable to the rising working class, which realized the 
necessity of a free and universal educational system to their own social and 
economic conditions. The memoriter system could not fit into this pattern. 

The demand for a free and universal public educational system presumed a 
curriculum which could be adapted to the abilities and interests of the major- 
ity of school-age children. Much of what the public schools taught was con- 
sidered to be rather useless for these children. In place of the memoriter 
system, educators proposed using the criterion of “social usage. The 


''k 


'®H. G. Good, A History of American Education (New York: The Macmillan Company, 
Publishers, 2nd Ed., 1962) p. 421. 



As in spcllint: so in arithmetic, scientific rcscarcli prew out of the practical 
problems of life and education. It was an cflbrt to test unverified beliefs 
and to mal.e \apuc and general statements precise and specific. It is not 
correct to say that educational reform was begun by the scientific investi- 
gators. On the contrary, they continued the trend already set in motion.'* 

Research was also needed to evaluate the claims made by those who fa- 
vored the memoritcr system and the principles encompassed by the concept of 
formal discipline. As early as 1890, William James had experimentally investi- 
gated formal discipline and was able to state, “. . . w'hcn schoolboys improve 
by practice in the case of learning by heart, the improvement will, I am sure 
be always found to reside in the mode of study of the particular piece and 

not at ail to any enhancement of the brute retentive power.”*** In 1901 
Thorndike and Woodworth published their important paper on transfer 
of training, whicli did much to destroy the presumed advantages claimed for 
formal discipline.'® 

As in educational administration, the first investigations into the curric- 
ulum and teaching methods were surveys of current practices. In 1907 for 


’“W. W. Charters, Curriculum Construction (New York: The Macmillan Commnv 
Publishers, 1923). 

‘^Good, A History of American Education, p. 415. 

'^William James, The Principles of Psychology (New York: Holt, Rinehart & Winston 
Inc., 1890) pp. 664-665. 

'“E. L. Thorndike and R. S. Woodworth, “The Influence of Improvement in one Mental 
Function Upon the Efficiency of Other Functions,” Psychological Review, VIII No 3 
(1901), 247-261. 
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example. Thorndike"'^ sliowed dial almost 82 per eent of tlie students who had 
entered school between 1900 and 1904 were eliminated from these schools by 
the ninth grade. Two )cars later, Ayre.s"' reported that only 10 per cent of the 
students who began school graduated from high school. These investigations 
implied that an immediate reform in all aspects of the curriculum was 
needed. 

The movement for educational reform had two general elTects. In the first 
place it encouraged the development of new innovations and practices to bring 
about needed changes. The literature of the 1920's and 1930’s was replete 
with new ideas, ranging from the development of core programs to interrelate 
subject fields, to the initiation of plans whereby individual students would 
“contract" for assignments. In the same era can be found innovations in the 
curriculum of the public schools. The combined effects of these changes did 
much to reduce dropout rates and increase learning efficiency, but did not add 
much to a science of education. 

The second effect of the reform movement was to encourage research into 
all areas of the curriculum. The motive was to justify the use of an innova- 
tion and to demonstrate how efficient or useful it might be. Literally thou- 
sands of studies were published which compared this teaching method 
against that or which showed the advantages of one curricular innovation 
against another. Very few studies were published which had theory to guide 
them, either in selecting variables to compare or in determining what new 
investigations were needed. Instead, much of educational research was trivial, 
repetitive, or poorly designed. 

Unfortunately, these conditions have not changed markedly even today. 
In 1964, for example, Ohles wrote," . . . what passes for research today is 
a frenzied effort to prove (not test) an innovation. since there is literally 
no end to the number of new ideas one can dream up, it follows that demon- 
strations and development projects alone are not likely to add to basic knowl- 
edge on how children learn. That few of these innovations have gained wide- 
spread support or acceptance attests to the weakness of the approach. 

In recent years, a new program has permeated the curriculum. In 1951, 
Beberman and others at the University of Illinois began working on the sec- 
ondary mathematics curriculum. This project was called the University of 
Illinois Committee on School Mathematics (UICSM), but is more commonly 
referred to as the “new mathematics.” It was designed to make mathematics 
more comprehensible, less laden with unexplained rules, and of greater 

-°E. L. Thorndike, Elimination of Pupils From Schools, U. S. Bureau of Education 
Bulletin (Washington, D. C. : U. S. Government Printing Office, 1907). 

2'Leonard D. Ayres, Laggard in Our Schools (New York; Russell Sage Foundation, 

^^22john F. Ohles, “The Futility of Change?” The Educational Forum, 29, No. 1 (1964), 
p 16. By permission of Kappa Delta Pi, an Honor Society in Education, owners of the 
copyright. 
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interest to students. Seven years later, the National Science Foundation 
supported the School Matiieinatics Study Group (SMSG), which prepared 
its own materials for use in the public schools. Similar projects are currently 
being developed by a number of other groups. Harold Hand has had this to 
say about these projects: 

Without exception all of the news items in the press and all the comments 
in the popular magazines concerning the new mathematics programs that I 
haxc encountered have been laudatory to some degree. . . . About three 
years ago. however, the distinguished head of the mathematics department 
in a large eastern university made a blistering attack on the new mathematics 
counxes. ... His attack \xas largely based on the grounds that the new 
courses neglected aspects of mathematics which youngsters need to learn. 
This was followed by a three page statement, also critical of the new mathe- 
matics programs ... which was signed by professors of mathematics at 
32 institutions. 

Neither school board mcmlxrrs nor the public at large has been told 
that there arc competent scholars in mathematics who seriously question 
the soundness of the highly touted mathematics courses. Nor have they been 
told that the experimental validation of a belief on which the new' programs 
in science as well as those in mathematics are banking is lacking.-^ 

It would be unfair to characterize all curricular and instructional research 
as being without theoretical justification, although it is true of the great 
majority. Fortunately, recent years have shown an increasing concern by 
educators to develop theoretical models and to test these models empirically. 
In 1962, for c.xamplc, Gagne-'* prepared a theoretical model to help in 
understanding the process of solving mathematical equations based upon 
learning sets. Piaget’s work on problem solving,-^ Guilford’s analysis of intel- 
lect,-® Bruner’s work on instructional theory,-" Carroll’s analysis of language 
instruction,-® Suppes’s study of mathematical reasoning,-® and Suchman’s 
work on inquiry training in science™ arc just a few of the recent contributions 
to educational theory. 


-^Harold C. Hand, "Integrity and Instructional Innovation,” The Ediicaiional Forum, 
30, No.l (1965), 9-10. By permission of Kappa Della Pi, an Honor Society in Education, 
owners of the copyright. 

^‘Robert M. Gagne, “The Acquisition of Knowledge,” Psychological Review, LXIX 
(July 1962), 355-365. 

^^Jean Piaget, Logic and Psychology (New York: Basic Books, Inc., Publishers, 1957). 

-®J. P. Guilford, “The Structure of Intellect,” Psychological Bulletin, 53, No, 4 (1956), 
267-293. 

^Jerome S. Bruner, The Process of Education {Cambridge, Mass.; Harvard University 
Press, 1960). 

®®John B. Carroll, “The Prediction of Success in Intensive Foreign Language Training,” 
in Training Research and Education, ed, Robert Glaser (Pittsburgh, Pa.: University Press, 
1962). 

^'’Patrick Suppes, “Toward a Behavioral Psychology of Mathematics Thinking,” Un- 
published manuscript, Stanford University, 1963. 

Richard Suchman, “Inquiry Training; Building Skills for Autonomous Discovery,” 
Merrill Palmer Quarterly, VII (1961), 147-169. 
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FACTORS HINDERING EDUCATIONAL 
RESEARCH 

All hough research has been able (o make valuable contributions to knowl- 
edge about education, it has nevertheless been unable to make the type of 
contribution whicli many educators have fell it should. As we stated earlier, 
educators have extolled the promises of research but have been disappointed 
in its results. In part, this is due to the fact that much of educational research 
has been used to evaluate innovations without developing basic or theoret- 
ical knowledge about education in general. There are, however, other con- 
ditions that have hindered the progress of educational research. These 
include the lack of funds for research, the general lack of skill among educa- 
tors in the methodology of research, the difTiculties in bridging the gap be- 
tween theory and practice in the schools, and the willingness of some educa- 
tors to accept unreliable or undependable research findings. 

The Lack of Funds for Educational Research 

Educational research cannot make the progress demanded of it until 
adequate funds are made available for equipment, manpower, and supplies. 
To be sure, even if sufficient funds were provided, research would still be 
hampered by inadequately trained researchers and the use of inefficient re- 
search designs. Nonetheless, without adequate expenditures for research, 
the best designs or the best researchers are likely to fail. 

Industry and business have been estimated to place between 5 and 15 per 
cent of their funds into research. By carefully explaining the values of 
research to stockholders and governing boards, industries have been able 
to appropriate rather large sums of money for both basic and applied prob- 
lems. Unfortunately, it has not been as easy for educational administrators 
to urge school boards into expending larger proportions of their budgets for 
research. 

Fortunately, however, a number of agencies have been willing to provide 
funds for educational research. In 1954, for example, the federal government 
was authorized under the Cooperative Research Program of the Office of 
Education to spend almost $1 million to enter into contracts with universities 
and state departments of education. These amounts were raised in subsequent 
years, so that by 1964 the federal government had appropriated approximately 
$34 million under the Cooperative Research Program; by 1966 some $70 
million had been allocated by Congress. 

These appropriations, though seemingly large, are still rather small; it has 
been estimated that less than 0.05 per cent of the total annual educationa 
budget has been granted for educational research. Compared with this, 
industry, business, and private foundations have been rather generous m 
providing research funds for education. In 1962, the Ford Foundation was 
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estimated to be granting more money to improve education than was the 
federal government.^' 

The federal government alone cannot provide the full support needed if 
research is going to live up to the demands placed upon it by educators. 
Other agencies (both public and private) should share the responsibility for 
providing adequate research funds. For example, universities and colleges 
arc estimated to provide anywhere from one-fifth to one-third of their budgets 
for research.-"- Public schools, in contrast, ordinarily devote 2 per cent of their 
budgets, and often less, to these activities. 

Ijck of Training in Educational Rc.scarcli 

One important reason that educational research has not made the contri- 
bution educators have demanded lies in the training of researchers themselves. 
Competent researchers simply do not develop in a vacuum — they must be 
selected with care and allowed to work and study in an atmosphere which 
respects intellect and scholarship. 

However, even assuming that professors of education are able to attract 
the very brightest students to work on advanced degrees, methods of teaching 
research methodology will have to be upgraded. One study"^ indicated that 
only 61 per cent of doctoral-granting institutions required work in measure- 
ment and research for a doctorate in education. One would expect an even 
smaller number of institutions to require work in research at the master’s 
degree level. 

Considering the need for research in education, it might be expected that 
professors of education would be devoting relatively large amounts of time to 
research. But college professors, like their counterparts in the public schools, 
are occupied with myriad administrative and teaching assignments, which 
cut rather heavily into research time. The result is that “ . . . even in the insti- 
tutions selected because of their research activities, most of the faculty 
members are officially assigned little or no time for research.”^'* 

Adequate research requires time to think about methods of attacking 
important problems. In an attempt to be objective as well as to encourage 
research among faculty members, many universities place a heavy priority 
on the number of research papers published by faculty members rather 
than on the quality of each project. The result is that the reward system 


^‘Lindley J. Stiles, “The Cooperative Research Program, Contributions and Next Steps,” 
Phi Della Kappan, XLIU, No. 6 (1962), 231-236. 

^-Nicholas A. Fattu, “A Survey of Educational Research at Selected Universities,” in 
First Annual Phi Delta Kappa Symposium on Educational Research, ed. Frank W. Banghart 
(Bloomington, III.,: Phi Delta Kappa, Inc., 1960), pp. 1-21. 

^^American Association of Colleges for Teacher Education, The Doctorate in Education, 
Conference Report, Vol. HI (Washington, D. C.: The American Association of Colleges 
of Teacher Education, 1961), p. 43. 

®'Fattu, “A Survey of Educational Research,” p. 9. 
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encourages much publication which duplicates well-established research or 
at best makes a trivial contribution. Thus, rather than devoting valuable 
time to planning for an important investigation, many researchers find the 
need to publish so strong that the quality of their research sufTers. 

The lack of training in research methodology among professional educators 
also stems from another source. In most of the academic disciplines such as 
chemistry. English, or mathematics, students planning to work on advanced 
degrees generally have completed an undergraduate major in their subject. In 
addition, if these students plan on teaching in the public schools, they prob- 
ably have taken at least one year's work in education primarily oriented to 
the acquisition of teaching certificates. Thus, if students are interested in 
working on an advanced degree in education, they ordinarily have under- 
graduate training which is stronger in their outside field of study than it is 
in education. For example, psychology majors usually have taken work in 
measurement, statistics, and research design before they enter the graduate 
school. Their counterparts in education who wish to specialize in educational 
administration, or in elementary or secondary education, begin their graduate 
study somewhat at a disadvantage because of their lack of undergraduate 
research training. This implies that the students in education usually need 
a rather long training program if they are to be competent researchers. 

Bridging the Gap Between Theory and Practice 

One factor which has retarded progress in education has been the difficulty 
of implementing educational research in the classroom even where theory 
exists. It has been estimated that the lag between the publication of research 
findings and the time it takes for these findings to be implemented in schools 
runs as high as 50 years'. With this excessive lag of time, it is little wonder 
that educators may conclude that research can have little effect on the public 
schools. 

Americans are pragmatic in the sense that they expect research to be judged 
by its products. Unfortunately, some persons have considered “products 
rather narrowly and have thus been concerned only with the immediate and 
practical utility of research findings. Unless educational research leads 
directly to educational reform, they become disillusioned. One is reminded of 
Krutch’s description of Thomas Huxley’s attempts to combine the search for 
“truth” with utilitarian values in his support of Darwinism. Krutch stated, “He 
[Huxley] had received letters from well-meaning old ladies who asked what 
good it would do to go about assuring people that they had apes rather than 
angels for cousins-german — even though he himself were sure of the fact-- 
and sometimes he felt the inconvenience of being compelled to defend his 
beliefs upon the double ground of their truth and usefulness.”®^ 


35Joseph Wood Krutch, T/ie Modem Temper (New York; Harcourt, Brace & World, 
Inc., 1929), p. 39. 
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Educators, much like Huxley, may feel the “ineonvenience'’ of having to 
increase knowledge about education as well as to provide for educational re- 
form. These two obiectives. although by no means incompatible, have tended 
to attract some advocates who assert that the primary function of educational 
research is to solve problems of a praetieal nature, and others who take the 
position that ultimately the best rescareh comes from the contribution theory 
can make to the teaching-learning process. 

The traditional distinction between basic and applied research was that the 
former was concerned with theory and the latter with practice. Thus Frank 
N. Freeman was simply describing the then-current status of basic and ap- 
plied research when he said. “The motive in educational research is practical. 
. . . The motive in pure science is different. The pure scientist, as ppre scientist, 
is not concerned with the practical consequences of his search for facts or 
laws.""'^^ 

But these stated differences between “practical" and “theoretical” may tend 
to obscure the interrelationships between the two activities. For example, 
the history of the physical sciences has indicated that what begins as a prob- 
lem in theoretical research may. some years later, be of great practical impor- 
tance. Thus, early workers in atomic theory did not predict the construc- 
tion of the atomic bomb or the use of radiation to combat cancer. The practi- 
tioners of science— the applied scientist and the technologist — have taken 
science's principles and have put its products to work to satisfy man's needs 
and desires. 

On the other hand, the “pure” or basic sciences have depended upon 
applied science and technology. Many industries, for example, employ large 
numbers of scientists to do basic research, in the hope, of course, that the 
knowledge obtained can be profitable. Thus, the chemical industries may 
employ as many scientists developing knowledge about chemistry as they 
do scientists whose primary responsibility is developing a salable product. 

In the social sciences, the interrelationship between basic and applied 
research is as much of a necessity as it is in the physical sciences; educators, 
as social scientists, need to develop reliable knowledge about education 
and to test the consequences of this knowledge in schools. Considered in this 
manner, the study of education involves both basic and applied research, 
each related to the other. 

Unwillingness to recognize the practicality of theory or the contributions to 
theory that applied research can make has led to an unfortunate split among 
educators. Thus one may hear “practical administrators” attacking “ivory- 
tower” professors for their lack of understanding of practical administrative 
problems. And, conversely, the educational theoretician may look with dis- 


^“Frank N. Freeman, “Controlling Concepts in Educational Research,” in The Con- 
ceptual Structure of Educational Research, T. R. McConnell, Douglas E. Scates, and Frank 
N. Freeman (Chicago; University of Chicago Press, 1942), p. 38. 
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dain upon llic adininislralor for his “anti-inlcllcctual” bias. Practical and 
theoretical matters should be considered as parts of a continuum with which 
all should be concerned, rather than as separate entities which acquire their 
own advocates. 

An attempt to implement basic research findings in the schools by applying 
the principles of group dynamics to facilitate change has led to the develop- 
ment of what has been called action or cooperative research, which is the 
source of much controversy in education. At one extreme are those who claim 
that action research is a new methodology original to and arising from 
educational problems at the other are those who contend that action re- 
search and scientific research arc incompatible.-’’® Instead ofjoiningthe debate, 
it may be more instructive to consider the characteristics of action research 
in greater detail. 

Action research in education developed in response to the need for translat- 
ing educational theory into workable classroom practices. Its intent, if not 
always its accomplishment, was to help teachers solve some of their problems 
by involving them in the research process itself. It recognized that the transla- 
tion of theory into practice requires the cooperation and personal involve- 
ment of teachers working closely with research specialists. 

An example may help to clarify the methods, strengths, and weaknesses of 
action research. In one study reported by Corey,®® the investigators were social 
studies teachers who, before the investigation was begun, tentatively accepted 
the hypothesis that there should be a positive correlation between the knowl- 
edge pupils have of famous characters in American history and the extent to 
which pupils admire these characters. The teachers stated, “This prediction 
is based on our belief that we should give more emphasis to the biographical 
method.” A second hypothesis was that admiration for characters in Ameri- 
can history should increase as a result of a one-semester course in American 
history. A third and final hypothesis was that there should be some relation- 
ship between the degree of admiration students feel for characters in Ameri- 
can history and the extent to which these pupils are judged to behave in 
accordance with traits similar to those found in historical personages. 

To obtain knowledge of the extent to which historical persons were ad- 
mired, a list of 28 names was passed out to students in three classes, who were 
asked to check every historical character for whom some degree of admira- 
tion was felt. Students were also asked to indicate on a 5-point scale the 
extent of their admiration (5 points for “Admire very much” and 1 point for 
“Admire merely because others do”). Each student received a “Degree of 

^^Norton L. Beach, “Research Goes into Action,” Journal of Educational Research, 
XLVII, No. 5 (1954), 351-358. 

^Robert M. W. Travers, An Introduction to Educational Research (New York, i 
Macmillan Company, Publishers, 2nd Ed., 1964), pp. 54-56. 

^®Stephen M. Corey, Action Research to Improve School Practices (New York: Bureau 
of Publications, Teachers College, Columbia University, 1953), pp. 61-70. 
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admiralion score. *' oblaincd by summing llic number of points given for each 
person admired and dividing by the number of persons admired. A socio- 
metric measure was used to evaluate peer group relationships, and a match- 
ing test of ten items was used to measure pupils' recognition of liistorical 
personages. 

For the three clas-^es combined, the teachers found tliat tlic correlation 
between the amount of information about historical characters and the 
degree of admiration was only 0 . 05 . The mean “Degree of admiration 
score" at the beginning of the semester was 3.70 and at the end. 3.79; the 
correlation between student reputations with classmates and admiration 
scores was 0.07. 

,'\ few comments arc in order concerning the execution of this study. In the 
first place, there is a great need for teachers to evaluate empirically their own 
beliefs and practices. .As its proponents readily admit, action research 
cannot be used to develop genera! theoretical positions or to test beliefs and 
practices having wide applicability. However, if the results of such investi- 
gations arc going to be useful to the teachers themselves, they should be 
aware of the extent to which currently obtained research findings arc appli- 
cable to their future classes of students. In the present investigation, this 
factor was not evaluated. 

Second, if the teachers were interested in whether or not they should give 
more emphasis to the biographical method, a correlation was not the appro- 
priate statistic to use since it does not imply causality. What is needed to test 
the hypothesis is an experimental comparison between the efTccts of the bio- 
graphical method and other methods which might produce important effects. 
Even if the correlation between amount of information about historical 
characters and degree of admiration were perfect (+ I.O), this does not mean 
that “learning about these accomplishments would result in admiration.” 

Third, action research in general suffers from a naive empiricism which 
refuses to examine what previous research has found. Even a casual search'’'’ -’^ 
through the literature would have pointed out that; 1) only about half of 
children’s favorite characters arc historical; 2) fewer than 10 percent of chil- 
dren select characters of the opposite sex; and 3) children do not always 
identify with historical characters who have personality traits in common 
with their own, but may identify with those having some traits quite divergent 
from their own. Perhaps even more important, one investigation had already 
been published which showed that knowledge about historical characters 
and students’ attitudes were largely independent of each other.'*- Had these 

■“’M. Louise Stoughton and Alice M. Ray, “A Study of Children’s Heroes and Ideals,” 
Journal of Experimcnial Education, XV, No. 2 (1946), 156-160. 

■"David Spence Hill, “Personification of Ideals by Urban Children,” The Journal of 
Social Psychology, I, No. 3 (1930), 379-392. 

■•^John R. Rackley, “The Relationship of the Study of History to Student Attitudes,” 
Journal of Experimental Education, 9 (Sept. 1940), 34-36. 
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tcaclicrs gone to (lie (rouble to review (he literature before developing their 
liypotlieses, they miglit not liavc used a list of 28 historical characters that 
contained the name of only one female (Harriet B. Stowe); (hey might have 
included contemporary heroes along with historical characters, and they 
would almost certainly have used some measure of character other than a 
sociomctric device. 

Fourth, (he tests administered may have been unreliable, as the teachers 
themselves suggested. This is likely since (he maximum “Degree of admiration 
score” was only 5 points. But, since the teachers did not bother to test the 
reliability of their instruments, there is no way of telling if the negative results 
were a consequence of unreliable measures, particular teaching methods 
employed, textbooks, teacher personality, etc. These factors were left uncon- 
trolled. 

Action research may help to reduce the lag between the discovery of knowl- 
edge and its application in the classroom. As such, it will demand more 
knowledge of research methods among its practitioners rather than less, and 
will require greater care in the dissemination and application of theoretical 
information by the academician. 

Uncritical Acceptance of Research Findings and Methods 

The uncritical acceptance of research findings is another factor that has 
hindered educational progress. The willingness of some persons to unques- 
tioningly accept any conclusion that is part of a research paper has been the 
source of much difficulty in education. Where data have been poorly collected 
or where experimental designs are weak, the application of research findings 
in the schools must, of necessity, be misleading. This uncritical acceptance 
of research information has the effect of blinding the student into refusing to 
question existing beliefs and practices; he will not investigate what is, at 
least to him, a well-established principle. 

Once accepted as a part of “knowledge,” these beliefs are remarkably 
resistant to change. One author has gone so far as to call the uncritical ac- 
ceptance of research findings the “standardization of error. jhat is, after 
an idea has been circulated and generally accepted, it is almost impossible to 
change the attitudes of those who originally agreed with it. A celebrated case 
in point is the purposeful hoax perpetrated by H. L. Mencken in 1917. Writ- 
ing in the New York Evening Mail, Mencken admonished his readers for 
failing to recognize “ . . . one of the most important profane anniversaries 
in American history, to wit, the seventy-fifth anniversary of the introduction 
of the bathtub into These States.” Mencken facetiously went on to describe 
some of the difficulties early bathtub users faced, such as attacks against the 
use of the bathtub by the medical profession, legislation restricting its use to 
certain months of the year, and the bathtub tax. 

^^Vilhjalmur Stefansson, Adventures in Error (New York: Robert M. McBride and 
Company, 1936). 
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Ntcnckcn \\as so successful in fooling the public that in May of 1926 he 
felt that the hoax had gone far enough, and he admitted publicly the incon- 
sistencies. errors, and deceptions which he had employed. But this by time 
the hoax had been too well accepted. It had been reported as fact in numer- 
ous professional journals, articles, and newspapers, and the error had been 
completely standardized. One newspaper went so far as to print Mencken’s 
admission only to reprint his original false article three weeks later! 

Researchers, whether they arc in education or the physical sciences, have the 
obligation to evaluate research methodology and not only to question the 
conclusions of research, but also to be aware that conclusions are dependent 
upon the manner in which data have been collected and analyzed. Failure to 
do so may lead to the continued acceptance of incorrect conclusions. 

In education, the uncritical acceptance of research findings is altogether 
too common. Studies and investigations arc reported which may take years to 
discount. .'\s an example, it is often cited as fact that a mental age of 6.5 
is the minimum necessary to begin a reading program. Others have dogmati- 
cally asserted that the minimum mental age is 6.0. Neither of these conclu- 
sions can be justified. They arc based upon a 1931 study by Morphett and 
Washburne’’' on the achievement of first-grade children in learning to read. 
These investigators found that almost half of the children studied who had 
mental ages of 6.0 or less failed to read up to the criteria established for 
satisfactorv’ reading, and that the majority of children having mental ages of 
6.6 or higher were able to meet these same criteria. 

However, an e.xamination of the materials required for reading in 1931 
indicates that they would be considered too difiicult for many of the children 
attending school today. In addition, the criteria for satisfactory reading 
were set at a higher level than most teachers today would require. The impli- 
cation, of course, is that with similar materials and better teaching techniques, 
mental ages need not reach some magic point before reading instruction may 
be begun, and that what constitutes failure at one period of time is not neces- 
sarily a constant for all periods. 

Reading is not the only area in which incorrect conclusions have been 
perpetuated. In educational measurement, for instance, numerous examples 
can be found of erroneous beliefs existing long after they were shown to be 
incorrect. Thus, many teachers still continue to compare achievement scores 
with IQ scores for the purpose of determining “under- and overachievers.” 
This practice began as early as 1920, when Franzen popularized the use of the 
so-called “accomplishment quotient,” a ratio of achievement test scores to 
intelligence test scores. A ratio of 100 meant that the child was doing as well 
as could be expected, a ratio of less than 100 meant he was underachieving 
and a ratio above 100 meant overachievement. It has been shown repeatedly 


^^Mabel V. Morphett and C. Washburne, “When Should Children Begin to Read?” 
The Elementary School Journal, XXXI, No. 7 (1931), 496-503. 
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that tlic use of such a ratio violates basic and necessary assumptions about 
the meaning of educational and psychological measurements. Indeed, Fran- 
zen himself later repudiated its use. Nevertheless, teachers continue making 
the comparison even though there arc sound arguments against doing so. To 
make things worse, many modern textbooks in education still continue the 
practice of making direct comparisons between mental age scores and such 
measures as reading or arithmetic age scores. What first appeared to have 
much educational merit later turned out to have enjoyed a use far beyond 
its values. 


SUMMARY 


1. Educational research has been characterized as showing great promise 
but few accomplishments. In part, the failure of educational research to live 
up to the high expectations of educators has resulted from the contradictory 
goals proposed for education and from the inability of educators to imple- 
ment research findings directly into the classroom. Whether or not research 
findings will be implemented depends upon their relationship to social, 
economic, and political factors operating in the community. 

2. A distinction was made between basic and applied research. The purpose 
of basic research is to develop theory; applied research resolves immediate 
and practical problems. The point was made that theory can suggest what 
variables are important in undertaking an applied research problem. Empiri- 
cal and theoretical studies are needed if applied research is not to become 
overly repetitious and trivial. 

3. Various types of research activities and their relationship to educational 
innovation were described: 

a. Development projects are used to increase efficiency and to lower operat- 
ing costs so that proposed innovations can be made practicable. Develop- 
ment depends upon knowledge from both theoretical and empirical studies 
to help justify the time and effort expended on a proposed project. 

b. The demonstration is used to persuade teachers and administrators 
that a proposed innovation is useful and desirable. It depends upon 
development projects to make proposals workable, but in turn it may also 
create new research problems as operating deficiencies and weaknesses 
are field tested. 

c. Three categories of research were described which contribute to both 
basic and applied problems: 

(1) The purpose of analytic research is to derive relationships deductively. 

It helps to point out implications and possible consequences of proposed 
innovations and helps to clarify assumptions behind proposed studies. 

It uses the language of history, philosophy, mathematics, and linguistics. 
Data retrieval was described as a form of analytic research designed to 
gather information from both primary (original) and secondary (non- 
original) sources. 
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(2’) Descriptive rcsearel: involves tlic use of correlations, surveys, case 
studies, direct observational tccliniqucs. cross-cultural methods, growth 
studies, etc., which arc designed to describe existing conditions without 
their being inllucnccd by the investigator. During the initial stages of an 
investigation, descriptive research methods help point out the extent and 
current status of a problem. 

(3) Experintentation is used to lest causal relationships by holding 
extraneous conditions constant to determine the cITcct one variable has 
upon another. .An experimental design is especially applicable in compar- 
ing the effects of two or more innovations. Experimentation often follows 
an.ilytic and descriptive investigations. 

4. Historically, educational research developed from the need to modify 
the curriculum and to evaluate various educational innovations. The motive 
for research was practical and utilitarian, with theory being given little con- 
sideration. Much of educational research today still suffers from a lack of 
theory and from an excessive number of fragmentary research studies which 
arc not organized into theoretical positions. 

5. Few empirical studies in education were conducted prior to the twentieth 
century. Educational research awaited the development of psychological 
techniques and methods (especially in testing) before educational problems 
were studied scientifically. Herbart (1776-IS41) is generally given credit for 
suggesting that it was possible to study education scientifically, if not experi- 
mentally. It was Wundt’s laboratory (established in 1879) that gave impetus 
to experimental methods in the social sciences. William James’s laboratory 
at Harvard (1875) and G. Stanley Hall’s at Johns Hopkins (1883) furthered 
experimentation in the behavioral and social sciences. 

Table 2 summarizes a number of other important nineteenth-century 
contributions to educational research. 

6. The rise of the psychological “schools” did much to encourage research 
in education. By emphasizing the values of introspection in studying the 
content of the mind, structuralists such as Wundt and Titchener encouraged 
the study of consciousness and awareness which modern techniques of inter- 
viewing and factor analysis have continued. The functionalists rose in oppo- 
sition to the strueturalists. As a functionalist, Dewey was more coneerned 
with the purpose of the mind than with the analysis of its contents. As the 
most deliberate spokesman for progressive education, Dewey did mueh 
to modify the sterile and impractical education demanded by the memoriter 
system and the theory of faculty psychology. 

Behaviorism rose to challenge both structuralism and functionalism. John 
Watson, who developed and popularized the movement, was concerned with 
the study of behavior, not mental functions or the content of the mind. 
Watson denied the concept of innate intelligence and saw the conditioned 
reflex as the means by which all organisms learn. Thorndike’s studies of 
human learning did much to further experimentation into human behavior, 
although he never formally joined the ranks of the behaviorists. 

The Gestalt school was founded by Kohler, Koffka, and Wertheimer in 
opposition to behaviorism. The Gestaltists emphasized molar analyses of 
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behavior and experience in contrast to thc bchaviorists, who insisted on a 
more molecular analysis of behavior. Thc arguments which raged between 
bchaviorists and GeslaJlists did much to develop new theories and to stimu- 
late rcsearcli. 


TABLE 2 

A Summary of Selected Nineteenth-Century Contributions to Educational 


Event 

Year 

Research 

Responsible Person 

Importance 

Origin of Species 
published 

1859 

Charles Darwin 

Showed that human beings could 
be studied and that they obey 
the same laws of nature as do 
other animals 

Expression of the 
Emotions in Man 
and Animals 
published 

1872 

Charles Darwin 

Showed that emotion could be 
studied in humans 

First testing center 
developed 

1882 

Sir Francis Gallon 

Helped popularize testing and 
the measurement of individual 
differences 

Development of the 
questionnaire 

1883 

Sir Francis Gallon 

Introduced possibility of study- 
ing large numbers of persons 
at a given time 

First experimental 

1885 

Hermann 

Developed the nonsense syllable 

analysis of learn- 
ing 


Ebbinghaus 

and various techniques for 
measuring learning and reten- 
tion 

Pedagogical Semi- 
nary published 

1891 

G. Stanley Hall 

Helped disseminate information 
on child growth and develop- 
ment 

Animal Intelligence 
published 

1898 

E. L. Thorndike 

Gave impetus to animal experi- 
mentation 

Talks to Teachers 
published 

1899 

William James 

Popularized educational psychol- 
ogy 


The psychoanalytic movement was begun by Freud in an effort to explain 
personality, especially abnormal personality. By emphasizing the study of 
individuals, Freud gave impetus to case study methods. 

7. The psychological schools were unable to continue unchanged for very 
long. In part, this was due to 1) rigid demands required by the early founders 
of the schools, which tended to alienate and create splinter organizations; 
and 2) the amalgamation of various positions as new techniques and methods 
of studying human behavior were discovered. 

8. Research in educational administration developed out of social needs to 
reform the public schools, in the same way that the public demanded reform 
in industry and government. The goal of nineteenth-century and early 
twentieth-century school administrators was greater efficiency of operations. 
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Tlic purpose of research \va<i to help administrators rcdiiee costs and increase 
school serv ices. 

A number of proressional orcanizutions in educational administration have 
done much to desclop a science of administration. With the help of the Kel- 
logg Foundation, the American .‘\ssociation of School Administrators, and 
various organizations of professors of administration, research centers have 
been established to study administrative problems and to develop and test 
theories of administrative behavior. 

9. The impetus for research on the curriculum developed out of practical 
needs. By the tvscnticth century, educators were faced with large numbers 
of students who found the prevailing curriculum rigid, ciiflicult. unmotivating, 
and unrelated to “real-life" conditions. The criterion of social usefulness 
was used to determine curricular content. This led to surveys of aetivitics 
engaged in by members of various occupations and professional groups. 

The need for curricular reform encouraged the use and evaluation of 
innovations in the public schools. Unfortunately, these innovations have not 
been systematically or thoroughly tested before they have been recommended 
for general use. Nonetheless, there have been a number of theories of curric- 
ulum and instruction proposed within the past few years, including those of 
Gagne. Piaget. Guilford, Bruner. Carroll. Suppes, and Suchman. which arc 
being empirically studied and evaluated. 

10. Although the use of research techniques has helped improve public edu- 
cation. a number of factors have hindered the development of educational 
research. 

a. Expenditure of funds. It was stated that expenditures for educational 
research arc inadequate to do the job which educators have demanded of 
research. 

b. Lack of training. Another factor which has hindered the development of 
educational research is the lack of training given to most professional edu- 
cators in research methods. It was indicated that even where adequate 
training in research has been provided, time factors and the “publication 
race” often interfere with the better judgment of researchers. 

c. Inability to relate theory and practice. One factor retarding the develop- 
ment of educational research has been the inability of educators to imple- 
ment research findings. The traditional distinction between basic and ap- 
plied research was modified so that the interrelationships between them 
could be emphasized. This led to a description and analysis of action 
research as an attempt to relate theory and practice. 

d. Uncritical acceptance of research finds. Because most teachers have 
been inadequately prepared to understand research findings and methods, 
they are likely to be uncritical consumers of educational research. Many 
of these uncritically accepted ideas are highly resistant to change. 

PRACTICE EXERCISES 


1 . Suppose that you are the superintendent of a small city school district and 
that you have a number of research findings and recommendations on your 
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desk. Indicate which of these recommendations you would be willing to 
implement in your schools, assuming, of course, that the findings are reliable. 
Indicate what factors led to your decision either to put these recommenda- 
tions into operation or to refuse to implement them. 


FimUngs 

a. Girls arc more mature than boys at 
comparable chronological ages. 

b. High school students who take 
courses in driver education have 
fewer accidents than those who arc 
not given such training. 

c. Students who retake courses after 
failing them do less well when they 
retake the course than do their coun- 
terparts who were passed. 

d. The correlation between teaching 
“success” and the amount of knowl- 
edge obtained in college courses 
yields low but positive correlations. 

e. In communities where playgrounds 
are made available, there is less 
juvenile delinquency than in com- 
munities which do not provide play- 
grounds. 


Recommendations 

a. Girls should enter school a year 
earlier than boys. 

b. Schools should provide courses in 
driver education. 


c. Students should not be failed. 


d. Administrators should select teach- 
ers more on their personality and 
character than on their achieve- 
ment. 

e. Administrators should allow stu- 
dents to use school playgrounds 
after school. 


2. Classify each of the following examples into the type of research or ac- 
tivity it calls for (basic, analytic, descriptive, data retrieval, development, or 
demonstration) : 

a. Two sets of data are correlated. 

b. A teacher looks up the research on the teaching of reading. 

c. A teacher tries to show parents the advantages of a new textbook in 
mathematics. 

d. An old course of study is being redone to make it simpler and more 
palatable to students. 

e. A student is interested in knowing the number of children who attended 
summer school during the 1965 summer session. 

f. A teacher believes that stuttering is caused by neurological problems. 

g. An experimenter reviews the literature to find evidence for some 
position. 

h. A business teacher installs a time clock in his classroom to see if this 
improves the attitudes of students toward being efficient. 

3. Examine in detail any of the following new programs. What assumptions 
does the method make about human learning? What evidence is there that the 
assumptions are correct? What other methods could be used that might bring 
about the same objectives? 

a. Team teaching. 

b. Ungraded classrooms. 
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c. Individualized reading programs. 

d. Cliemieal Bond Approacli. 
c. 1’1C5M maih program. 


SUPPLKMRNTARV RK.VDINGS 


1. .Abclson. Philip H.. “Congress and Research,” Science, 139, No. 3552 
(Jan. 25. 1963). 305. This article indicates tlic need for greater amounts 
of money for educational research. The author points out some of the 
dangers involved in the acceptance of research grants. 

2. Barr. .A. S.. “Research Methods." in Encyclopedia of Educational Rc- 
.^carch. cd. Chester NV. Harris (3rd ed.) (New York; The Macmillan 
Company, Publishers. 1960). pp. 1162-1166. Part of this chapter contains 
a brief but well-documented history of educational research organized 
into three parts; educational Research Before 1900; Educational 
Research, 1900 to 1925; Educational Research After 1925. 

3. Boring. Edwin G.. A History of Experimental Psyeltology. New York; 
Applcton-CenturA-Crofts, 1950. 777 pages. Although not specifically 
related to the historical development of educational research, this text 
docs describe in detail the rise of science and the development of psy- 
chology as a scientific enterprise. The origin of modern psychology 
within philosophy is treated in Chapters 9-13, the contributions of 
Wundt arc described in Chapter 16, and Chapters 21 and 22 are con- 
cerned with the establishment of psychology in America. 

4. Lazarsfcld. Paul L., and Sam Sicber, Organizing Edueational Research. 
Englewood Cliffs, N. J.; Prentice-Hall, Inc., 1964, 113 pages. A short 
but excellent account of the relationships among the various organiza- 
tional structures within educational research bureaus. Of special rele- 
vance to this chapter is Chapter 3, “Problems of Educational Research 
and Research Institutes.’’ 

5. Miles, Matthew B., Innovations in Edueation. New York; Bureau of 
Publications, Teachers College, Columbia University, 1964, 689 pages. 
An excellent analysis of the factors which retard and advance educational 
progress. 

6. Morse, Arthur D., Schools of Tomorrow — Today. New York: Doubleday 
& Company, Inc., 1960, 191 pages. This is a progress report on various 
educational experiments such as the use of school aides, team teaching, 
and television. The selections are nontechnical and are designed to pro- 
vide the reader with an overview of new approaches to persisting educa- 
tional problems. 

7. Postman, Leo, ed.. Psychology in the Making: Histories of Selected 
Research Problems. New York: Alfred A. Knopf, Inc., 1962, 785 pages. 
Students will find the introduction to these readings of interest. Although 
specifically titled “Some Guides to the Understanding of the History of 
Psychology,” this chapter is an attempt to put research into a cultural 
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context and, as sucli, it provides an excellent framework for research in 
disciplines other than psychology. 

8. Stanley, .lulian C.. “Doctoral Students and Research in Educational 
Psychology." School and Society, (Nov, 3, 1962), pp. 375-377. The author 
outlines a training program for educational psychologists which empha- 
sizes high standards of selection and training. His plan, if followed, 
should do much to alleviate the lack of training in research methods. 
The article, while restricted to the training of educational psychologists, 
could very well be applied to the training of specialists in other areas of 
education. 



CHAPTER THREE 


Selecting a Research Problem 


The student who is attempting to formulate his first research project often 
finds himself in a bewildering situation. He may have repeatedly come across 
statements from his instructors and from textbooks recommending additional 
research to help clarify the many pressing problems in education. Thus, 
often armed with the loftiest ideals, he begins his search for a problem 
worthy of investigation. Almost immediately, however, his project may be 
criticized as being unimportant, unnecessary, too impractical, or already 
“worked to death’’ by other investigators. 

One reason students find it so difilcult to select a research problem is that 
they often confuse problems with methods. A problem is “a perplexing 
situation after it has been translated into a question or series of questions 
that help to determine the direction of subsequent inquiry.”' In contrast, 
a method is a procedure used in resolving problems. To begin by considering 
method without having a clear formulation of the problem is to invite trouble. 
The student who proposes to investigate the eorrclation between intelligence 
and achievement test scores, for example, is eoncerning himself with a method. 
What he has failed to indicate is the need for an investigation on this topie. 

Researeh problems consist of questions that ean be justified on grounds to 
be diseussed later in this chapter. The proeess of justifying questions is ex- 
tremely important, because it implies that not all problems are of equal value 
or importance. It is the responsibility of the researcher to demonstrate the 
need for a particular type of investigation to justify spending time, effort, 
and funds on one study rather than another. 

The neeessity of justifying research problems stems from a number of 
sources. In the first place, scientific endeavors are public matters; as such 
they command the interest and efforts of the scientific community at large. 


’Carter V. Good, ed.. Dictionary of Education (2nd ed.) (New York: McGraw-Hill 
Book Company, 1959), p. 414. 
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The investigation of a strictly personal problem having applicability to 
oncsclfalonc is not likely to contribute to a science of education. 

Second, it is not possible Tor researchers to investigate all of the many 
problems educators face. Thus, it is necessary to be selective about those 
problems which arc to receive priority. Decisions concerning these priority 
judgments require criteria for their evaluation. A number of criteria have 
been proposed for justifying the selection of a research problem. 

The Criterion of Interest 

The criterion of interest is a necessary but not siifhcicnt reason for selecting 
a particular research problem to investigate. Without interest in a topic, 
the effort and care characteristic of well-designed research studies are likely 
to be lacking. Interest is not, however, a sufficient criterion, since it can lead 
researchers to investigate trivial problems as well as important ones. As we 
have already pointed out. the nature of scientific research demands that 
findings be communicated, and little is gained by communicating matters 
that do not concern other scientists. This by no means requires the researcher 
to select a problem which is of concern to everyone. It is the probability of a 
study making a contribution that determines its value to other scientists, but 
the researcher is not obligated to select a problem that is first on the priority 
list. A study designed to count the rocks on a playground may provide us 
with information and may even be of interest to the person doing the count- 
ing, but the probability of its being of interest to anyone else is low. 

Interest does not necessarily imply agreement with a given state of affairs. 
That is, one does not have to be in agreement with a body of knowledge in 
order to investigate some aspect of it. Many of the most important investi- 
gations have been performed as reactions against currently accepted beliefs. 
This type of research is important because it points out weaknesses m 
previously conducted studies and stimulates research on new topics. Accepted 
positions can be differentiated, investigated, and reformulated in the light of 
new research findings that stir up controversy. 

The Economic Criterion 

Another criterion for selecting one research project over another is econom- 
ic. The realities of life may force the researcher to reject an investigation 
if his estimates of cost are larger than his available funds; costs also may 
force him to limit the breadth or complexity of a proposed study. While hardly 
a justification for undertaking a research project, costs related to the hiring 
of personnel, the use of computing facilities, the construction or purchase o 
equipment and materials, and overhead must be considered, especially in 
“applied” research, where some ratio of cost per yield is often require 
When the researcher expects some sort of economic return for his expenditures 
(as, for example, in industry), then costs can be computed. In “pure or ba^c 
research, where the contribution is primarily theoretical, the yield may e 
impossible to estimate. 
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There is. of course, no justification whatsoever for undertaking a project 
simply bccau>ic it is incvpeiuiivc or ca'^y to execute. Like tlie criterion of 
interest, costs mu<it be con<>idcrcd in any investigation, but do not in and 
of themselves provide sufheient iu*;tificalion for selecting a research 
problem. 

Tlic Imesligntnr’s .\hility and Training 

.•\nother factor to be considered in the selection of a research problem is the 
;>nr.sf/c<7tor’.s ahiliiy and training. Tvery person embarking upon a research 
career has limitation*; in experience and capacity which he should recognize 
if he is to avoid unncce';';arx' fru‘;tration. It is at this point that intellectual 
honesty with oneself is cs‘;cntial. Not everyone is capable of undertaking 
complex research problems: it is a sign of maturity to be able to recognize 
one's own limitations. 

Even if an investigator is /lorc/ir/W/r capable of undertaking an elaborate 
research study, there is still the matter of liis training and the amount of time 
he may be willing or able to devote to the project. The design of some studies 
is almost certain to require the investigator to have competence in areas 
where he has not had formal training. In some instances, this may be remedied 
rather quickly by reading a number of articles or texts or by asking someone 
who is competent to help on the project in an advisory capacity. On the other 
hand, taking a course in projective techniques docs not by itself lead to 
competency in projective testing. It may lake a great deal of practice under 
supervision to interpret some tests. The student should be able to evaluate 
his strengths and weaknesses before he undertakes a research project. To 
wait until the project has begun is to invite needless delay at best and an 
incomplete or meaningless project at worst. 

The Criterion of Uniqueness: the Problem of Replication and Generalization 

The criterion of uniqueness assumes that research projects have some 
originality in either purpose or method. It is most unlikely, of course, that 
the novice researcher will come across a problem never before considered; 
we will concern ourselves here with the question of the advisability of 
duplicating research that has already been completed. 

Suppose, for example, that a fifth-grade teacher decides to evaluate the 
effectiveness of a new method of teaching fractions by experimenting with 
the students in her class. Half of her students are given the new method and 
the other half are taught by her usual procedure. Now if the group taught by 
the new method actually did learn fractions “better” than the group taught 
by conventional methods, what could this teacher legitimately conclude? 
Certainly she could not generalize from her findings and recommend the new 
procedure unquestioningly for all fifth-grade teachers or for all fifth-grade 
children. Because other fifth-grade teachers and classes were not used, her 
findings have limited application and would therefore be of less generality 
than a study which involved numerous classes and numerous teachers. A 
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more comprehensive study is required. It would be perfectly reasonable for a 
researclier to take a study that was originally limited in scope to try to make it 
more comprehensive and, ultimately, of wider applicability. 

On the other hand, not every study which involves some event needs to be 
replicated, or repeated, using various groups, if the conditions which underlie 
the event arc made explicit. Thus, fairly unique events may be investigated 
if the underlying theoretical conditions arc specified. For example, on October 
30, 1938, the originally scheduled radio program on the Mercury Theatre 
was “interrupted" by the announcement that Martians had invaded the 
United States. Almost immediately, panic broke out among the program 
listeners, many of whom believed the story of the invasion to be true. As 
one investigator reported; 

Long before the broadcast had ended, people all over the United States 
were praying, crying, fleeing frantically to escape death from the Martians. 

. . . Such rare occurrences provide opportunities for the social scientist 
to study mass behavior. . . . The situation created by the broadcast was one 
which shows us how the common man reacts in a time of stress and strain. 

. . . The panic situation we have investigated had all the flavor of everyday 
life and, at the same time, provided a semi-experimental condition for 
research. In spite of the unique conditions giving rise to this particular 
panic, the writer has attempted to indicate throughout the study the pattern 
of the circumstances which, from a psychological point of view, might make 
this the prototype of any panic f 

In the study of education, occasions arise when nonreplicable, unique 
events may be investigated. The process of school integration, for example, 
would be difficult, if not impossible, to study in other contexts or under other 
conditions. Thus, a unique event may be studied as long as the conditions 
are stated which make it a model for other related and similar events. 

In another sense, uniqueness as a criterion for the selection of a research 
problem does not require that every event be studied in every context. This 
relates to the problem of just how far research findings can be generalized. 
Usually, the most useful investigations are those which allow the researcher 
to make the broadest and most inclusive generalizations concerning any 
given topic; conversely, investigations which are of limited applicability, 
either theoretically or practically, are of less value. Thus, a hierarchy of prob- 
lems can be formed, with the most inclusive one having the highest priority. 
In practice this would mean that, given a choice of possible problems to be 
studied, the student would be making the greatest contribution by selecting 
the problem that has the greatest probability of yielding results which lead to 
general theories and laws. 


2Hadlev Cantril, “The Invasion from Mars,” in Readings in Social Psychology, (3rd ed.). 
pH Fleanor E Maccoby, Theodore M. Newcomb, and Eugene L. Hartley (New Yor . 
Holt, Rinehart & Winston, Inc., 1958), pp. 291-300. Italics added. Reprinted by permis- 
sion of Princeton University Press. 
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Rnsr:ARCH to clarify and validate 

BASIC THEORETICAL PROBLEMS 

In Chapicr One we defined a theory as a unified system of definitions, 
rosliiiates. and observ aliens organized in such a way as to most simply 
explain tiic intcrrclationsliips between variables. We also pointed out that 
wliilc llicorics themselves cannot be investigated directly, there are empirical 
consequences predictal'lc Irom theory wliich can be validated. If these 
Consequences arc fv^und to be in the predicted direction, they lend credence to 
the theory ; if not. the theory will have to be modified to account for excep- 
tions. 

There arc two ways in which theory can aid in the selection of a research 
problem. I-irst. research projects can be undertaken to help clarify, limit, 
and define theoretical formulations. Take, for example, the interference 
theory of forgetting described in Chapter One. Somewhat oversimplified, it 
states that forgetting occurs because newly acquired information is interfered 
with by both previous and subsequent learning activities. This brief statement 
of the theory, however, leaves many questions unanswered. For example, 
w hat is the relationship between number of previous {or subsequent) learning 
activities and amount of forgetting? Do previously learned activities in- 
terfere more than do subsequently learned activities? Do all activities interfere 
with newly acquired information or can some activities facilitate retention? 
Each of these questions forms the basis of a research problem which can be 
justified on the grounds that the research will help to clarify the meaning of 
the theory. 

Second, the consequences of theory can be used to test indirectly the 
validity of the theory itself. The interference theory, for example, implies 
that; I) there should be a positive correlation between amount learned and 
amount of forgetting; 2) material located at the ends of lists to be learned 
should be retained better than material located at the center of the list; and 
3) not all activities interfere with retention since, for example, previous 
knowledge of how to play the violin may facilitate learning the viola. Each 
of these implications provides a basis for a research problem. 

The relationship between empirical investigations and theory can be seen 
by examining Figure 1, where the ETs represent empirical investigations 
designed to help develop a body of theory. Each empirical investigation 
adds further knowledge to the development of a theory. In turn, the theory 
implies certain consequences (C), whose validation lends credence to the 
theory. In the beginning stages of theory development, the empirical investi- 
gations provide information about the theory; once the theory is better 
understood, the consequences of the theory are tested to determine if they are 
in accord with what the theory predicts. In the selection of a research problem, 
investigations may be chosen at either the El level or the C level. In either 
case, the student should be familiar with the major empirical investigations 
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Fig. 1 

The rc/alionship between empirienl investigations and theory development. 

leading to the formulation of the theory and to studies which have tested the 
consequences of the theory. 


RESEARCH TO CORRECT METHODOLOGICAL 

ERRORS 

Research to Clarify Contradictory Findings 

The principle of determinism requires that investigators examine research 
methods for possible discrepancies if there are contradictory conclusions 
from research investigations. Where experimental designs have been weak, 
conclusions based upon these designs are open to serious question. 

An example will help demonstrate the point. In discussing imderachieve- 
ment, Peterson has indicated a number of research findings which seem to 
contradict each other: 

Consider these conclusions, for example. It has been observed that the 
father of the low achiever has less education and ranks lower in occupation- 
al status than the father of the high achiever. Yet, another study states the 
opposite — more education and higher occupational levels among the fathers 
of low achievers. And a third study finds no difference in educational or 
occupational level between the two groups. 

Helpful? Let’s look further: The home of the underachieving student is 
more likely to be broken by death or divorce, or, the loss of one or both 
parents has no effect on achievement. Take your choice. 

Is birth order important? One author states that the achievement of the 
only child or the oldest sibling is poorest. Another reports no significant 
differences between older and younger siblings in intelligence or achieve- 
ment.® 

In the example just cited, an apparent contradiction in findings could 
lead a researcher to design studies which might provide more definitive 
answers concerning the characteristics of the underachiever. In the first 
place, the definitions of “underachievement” were different in each of these 
studies. Peterson himself has indicated that the use of four different criteria 

®John Peterson, “The Researcher and the Underachiever: Never the Twain Shall 
Meet,” Phi Delta Kappan, XLIV, No. 8 (1963), 379. 
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for determining wlmt sliall be considered underachieving behavior probably 
contributed to the wide discrepancy in reported findings. In some studies, 
underachievers may be from widely din'erent types of scliools or from dif- 
ferent communitic‘>. and may vary considerably in age and grade. In addition, 
the estimation that the child is able to do better work than he is actually 
doing may come from different sources. In some instances the source 
may be the teacher's judgment: in other eases, it may be standardized test 
results. Because the characteristics of underachievers arc determined by 
such diverse sources, each having dilTcrcnt criteria as to what constitutes 
undcrachicvcmcnt. studies arc likely to show contradictory findings. 

.lust how could one select a problem which attempts to clarify contra- 
dictors' findings? I'sing studies on uiulcrachievement as an example, the 
researcher could repeat earlier contradictory investigations, selecting a 
number of different types of schools in different communities, using ele- 
mentars' and high school children of both sexes, and specifying his criteria 
for determining undcrachievement. To be sure, this would lead to a rather 
complex study, but it would help to clarify findings which now appear to be 
inconsistent. 

Research to Correct r.aully Methodology 

Another source for selecting a research topic may be found in generally 
accepted conclusions which are based on faulty research designs. In educa- 
tional and psychological measurement, for example, it is generally well accept- 
ed that scores which arc corrected for guessing tend to correlate very highly 
with uncorrcctcd test scores. This conclusion is based upon the following 
type of research design: 

1. One group of students takes a test. 

2. The papers arc scored twice, once by correcting for guessing and once 
without the correction. 

3. The correlation between corrected and uncorrcctcd scores is computed. 

The results invariably indicate a very high correlation, and this evidence 
is used to argue against correcting examination papers for guessing. The 
reason given is that since the scores are highly correlated, they must be 
measuring the same factors. However, Davis has indicated that the research 
design is faulty: 

The writer discounts statements that the correlations between sets of 
test scores obtained with and without correction for chance are exceed- 
ingly high. In the first place, the correlations cited are usually spuriously 
high because they are obtained by scoring the same set of papers in two 
ways. In this situation, the directions for administering the tests are the 
same and thus can be appropriate only to one of the two scoring procedures. 

It would be desirable to obtain the correlation between two comparable 
forms of the same test administered successively to the same sample with 
two sets of directions — one appropriate to scoring without correction for 
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cliancc svicccss and one lo scoring \vil!i il. This correlation should be com- 
pared with a parallel-forms reliability coefficient [see Chapter Seven] for 
the same test based on the same sample. An exact test of the significance of 
the ditfcrcncc bctuccn the two coefficients would permit inferences to be 
drawn regarding the point at issue,' 

Numerous oilier e,\amp)es can be found in the literature where faulty 
researeh proeediires have stimulated investigators to correct and improve 
upon designs. I-'or example, in the original construction of the F scale (a 
measure of authoritarianism), all items were so worded that agreement signi- 
fied hostility, cthnoccntrism. and intolerance. However, Messick and Jackson^ 
pointed out that persons taking the test who had a general tendency to agree 
to any set of statements regardless of content would be considered to be 
undemocratic although they could simply be displaying their tendency to 
acquiesce or agree. The authors indicated that a number of studies have been 
made to investigate and to reduce this type of tendency, or response set on 
the F scale. 

In general, many rcscarcli topics suggest themselves after a careful analysis 
and critique is made of previously conducted studies. The attitude to guard 
against is being overly critical on minor or unimportant details. To criticize 
and replicate a study because of some unimportant detail adds little to 
knowledge. 

Faulty Use of Statistics 

Another type of faulty methodology involves the use of inappropriate 
statistics for analyzing data. Often an important study yields questionable 
results because the statistics used are not applicable. These studies may 
be replicated using more appropriate statistical methods. 

An example or two may be helpful at this point. In early investigations 
involving the relationship between cigarette smoking and the prevalence of 
lung cancer, researchers computed correlations between the number of 
cigarettes smoked per day and the prevalence of cancer. What the researchers 
really wanted was evidence as to whether or not smoking caused lung cancer; 
what they actually obtained was the correlation, or degree of relationship, 
between smoking and cancer. This information, while useful, could not be 
used as decisive evidence showing a causal relationship. The researchers 
failed to recognize that correlations do not necessarily imply causality. 

On a much broader level, the million-dollar PROJECT TALENT research 
sponsored by the Cooperative Research Branch of the U. S. Office of Educa- 
tion has been criticized on essentially the same grounds. As Stanley has 
stated : 

‘‘Frederick B. Davis, “Item Analysis Techniques,” in Educational Measurement, c6. 

E F Lundquist (Washington, D. C: The American Council on Education, 1951), p. 27 . 

‘ ^Samuel Messick and Douglas N. Jackson, “The Measurement of Authoritarian 
Attitudes,” Educational and Psychological Measurement, XVIII, No. 2 (1958), 241 
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1 admire the testing opcralioii itself. The .American Institute for Research 
and the I'nivcrsity of Pittsburgh have pood cause to be proud of it, despite 
a few incsitablc flaws in design and cvccution. It is the promised attempt 
to tca<-e out “causation" from essentially eorrclational data that gives me 
pause. . . . 

\ icwcd narrowly, all ten questions (asked by the PROJECT TALENT 
sla(T] deal only with a'-'^oeiaiion. not eausation, but straightway they have 
causal implication<i that might Ik misleading. Take No. 3, for example; 
“Arc small clas'^c^ more ctTcctivc than large classes?" One can compute 
quite readily the correlation of class si/c as it occurs “naturally" in PRO- 
JECT TALENT schools with various test scores, but it is a far more dif- 
ficult task to prose that cl.Tss si/c helps “cause" the differences among 
means of ckasscs and that therefore classes “should" be of a certain size or 
sizes in order to maximize desired outcomes of instruction.*'' 

The use of an inappropriate statistic is not an uncommon occurrence even 
in published research reports. Thus Lewis and Burke’ have slated; 

To confirm a general impression that the number of misuses of X' [chi- 
square] has become surprisingly large, a careful survey was made of all 
papers published in the Jottnuil of llxporiincntal Psychology during the 
three years 1944. 1945. and 1946. Fourteen papers were found which con- 
tained one or more applications of the chi-square test. The applications 
in only liircc of these papers . . . were judged to be acceptable. On one 
other paper .... tiic sexeral applications could be called "correct in prin- 
ciple" but they involved extremely small theoretical frequencies. In nine 
of the fourteen papers . . . the applications were clearly unwarranted. In the 
remaining ease, it was not possible to determine what had been done; and 
the author, when questioned twice by letter, did not choose to reply.*' *’ 

If the research or article is judged to have some theoretical or practical 
importance, then it could very well be replicated using a more appropriate 
statistical technique. 


RESEARCH TO RESOLVE PRACTICAL 
FIELD PROBLEMS 

Many important research projects develop out of attempts to solve practical 
problems faced by classroom teachers and administrators. These problems 
are called practical, not because they lack theoretical bases, but because the 
intent of the investigator is to study a pressing and immediate problem. 
Thus, for example, a classroom teacher might be concerned about the number 


^Julian C. Stanley (Book Review), Teachers College Record, LXIV, No, 5 (1963), 433- 
434. 

^Don Lewis and C. J. Burke, “The Use and Misuse of the Chi-Square Test,” Psycho- 
logical Bulletin, XLVI, No. 6 (1949), 433-489. 

®Lewis and Burke, “The Use and Misuse of the Chi-Square Test,” p. 433. 

®For a rejoinder to the Lewis and Burke article and their defense see Psychological 
Bulletin, XLVII, No. 4 (1950), 331-355. 
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of spelling words or aritlimctic problems her students can cfTcctively learn 
during an hour period of time. Her interest is only in her students and in 
solving a problem which faces her and which demands immediate attention. 
Similarly, an administrator may want to utilize his slaflT most effectively to 
direct extracurricular activities in his school. He may very well recognize 
that his findings might apply to other schools and other administrators, but 
his primary intent is to solve hix problems rather than similar problems faced 
by other administrators. 

In a sense, the problems faced by the administrator and the classroom 
teacher have implications that extend beyond the immediate ones. The 
teacher will no doubt apply current findings on spelling and arithmetic to 
her next year's classes. The administrator who finds that his staff was most 
effective when allowed to choose its own extracurricular activities to supervise 
will probably encourage new staff members to select their own supervisory 
functions in future years. The assumption which they both make is that future 
classes and future members of the staff will act in the same way as the subjects 
did when the study was undertaken. However, this conclusion is valid only if 
the characteristics of the students or teachers remain constant over time. 
The teacher and administrator will have to repeat their investigations 
every year to be sure that the characteristics of their subjects are not 
changing. 

Thus, even where the intent of research is to help resolve practical diffi- 
culties, the researcher still has the responsibility for determining the limits to 
which the study applies and for designing a well-controlled study. A teacher 
who finds that ten minutes per day devoted to spelling yields optimum benefits 
will have to remember that these findings hold only for the kinds of students 
who are in her classes the year the study is made. Next year’s students may be 
either brighter or duller than her present group. 

Would it not be more practical, then, for the teacher to know the minimum 
periods of time required for spelling at various levels of student abilities and 
aptitudes than it would be to know that this year’s students require only ten 
minutes of spelling instruction per day? And once having this information 
would it not be of use to other teachers? The point is that research which has 
limited application is limited not only for other teachers but for the teacher- 
researcher himself. By making the research more comprehensive, the teacher 
makes it more practical for himself; at the same time he can contribute 
materially to the benefit of his colleagues. Research which is highly restricted 
to one given condition (i.e., spelling) in one given classroom is not only 
unlikely to arouse wide interest, but may not actually be of great value to the 


researcher. 

Somehow many persons have the attitude that if the reasearch is to solve 
a practical problem, a type of research which is well controlled and which 
involves a statistical analysis of data need not be applied. Nothing could be 
farther from the truth. As Massialas and Smith point out; 
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Al the finecrtips of the classroom Icaclicr lie itiinimcrablc opportunities 
for rc'^eorch uhich may he the source of additional insight into many of the 
proWemo of understanding the teaching-learning process .... A system- 
atic. ihoughlful. and vigorous approach to the investigation is necessary 
if sse arc to expect a clear design and valid strategy of attack. Only when 
tight and organired frames of reference arc consciously employed will the 
held of education move toward quality research.'' 


PCnUSliED SL GGESTJOXS FOR SELECTING 
RESEARCH TOPICS 


From time to time, suggestions for selecting research topics liavc been 
published; they may be of some help to graduate students as they begin their 
search for adequate topics. .Many c>r these suggestions, while wortlnvhilc in 
general, may not be suitable for any given student. It should be kept in mind 
that the interests and capabilities of the researcher are important criteria for 
the selection of a research topic. In addition, a number of local considerations 
such as equipment, subjects, and the requirements of various graduate de- 
partments may not allow the student to pursue a given research topic. Sug- 
gested topics, may, however, provide the student with some idea as to what 
types of studies arc needed. As suggestions, they arc by no means prcscrip- 
livc. 

Suggestions for Research in Measurement 

One e.xccllcnt set of suggestions about possible research topics for graduate 
students has been published by the Educational Testing Service." Although 
the list docs not contain specific methods which could be used in attacking 
these topics, the student may find some useful ideas in the twelve suggestions 
which follow: 

1. Structure in the essay question as it alTccts the scoring reliability and 
the test reliability. 

2. Determining characteristics of test items at the time of writing. 

3. Comparison of group tests vs. individual tests of intelligence or academ- 
ic ability. 

4. The effects of reducing the administration time of tests. 

5. The relative values of r biserial and D as guides to item selection. 

6. The relative merits of entrance test scores and first year grade point 
averages as bases for predicting college success. 

7. The relative merits of status measures as predictors of success in high 
school. 

8. Effects of different teaching methods used in tests and measurement 
courses for students in education. 


’“Byron G. Massialas and Frederick R. Smith, “Quality Research — A Goal for Every 
Teacher,” Phi Delta Kappan, XLIII, No. 6 (1962), 256. 

“Evaluation and Advisory Service, List of Suggested Studies for Graduate Students in 
Tests and Measurement (Princeton, N. J. : Educational Testing Service, 1960). 



78 


Si:u;cTiNG A RrsEAUcn Prodlkm 


9. Tlic rclalionsliip bclwccn creativity and scores on general ability tests. 

10. The elTecls of various meclianical means used by the student in reeord- 
ing lest responses. 

1 1 . Prediction of properties of test .scores for multiple choice items. 

12. The possibility of finding groups of test items which arc “reproducible.” 

Suggestions for Research on Gifted Children 

The Division of .Scliool Psychologists of the American Psychological 
Association has published a list of research topics concerning the education 
and psychology of the gifted child.'- In general, these suggestions fall into 
11 categories; administrative procedures related to grouping, enrichment, 
etc.; organization and amount of schoohvork and its effects on personality 
and intelligence; the relationship between ability and performance; the 
teacher's role in educating gifted children ; the vocational aspects of educating 
gifted children; personal relationships of gifted children to others of lesser 
and equal abilities; the special frustrations and problems faced by gifted 
youngsters; the special satisfactions of being gifted; the determination of 
factors responsible for undesirable personality traits in gifted ehildren; the 
status of gifted children as a possible minority group; and the needs of 
gifted children with regard to the development of desirable citizenship traits. 
Many of these suggestions could also be made applicable to retarded students 
or to students having emotional or physical problems. 


Suggestions for Research on the Curriculum 

A number of persons have suggested needed research concerning the 
curriculum. Passow, for example, has stated : 

Research is needed for developing and testing conceptual frameworks and 
theories that underlie curriculum building. . . . Needed are more compre- 
hensive curriculum-research projects — an investigation for example, of the 
total educational program as it affects the learning patterns of youngsters. 
Among a few researchers there has been the tendency to analyze a thin slice 
of some overriding problem. Comprehensive research plans dealing with 
basic educational problems have not been undertaken in sufficient num- 
bers .... Also needed are more longitudinal studies.'^ 

Clymer has also suggested some needed research : 

1 . The need to evaluate present status of research findings. What has research 
really uncovered thus far ? 

2. The need to develop a theoretical framework into which all present 
knowledge will fit. What are the theoretical principles that serve to unify 
this knowledge? 

3. The need to improve certain characteristics of educational research. 
What statistical and design factors of research need improvement ?'^ 


'^Gertrude Hildreth, George Myer, Lee Meyerson, Paul Witty, and Harriet E. O She , 
“Needed Research on Gifted Children,” American Psychologist, IX, No. 2 (' 954 ), 77-7 . 

'^Harry Passow, “Curriculum Research: Status, Needs, and Prospects,” Ediicationa 
np^earch Bulletin, XXXIX, No. 8 (I960), 197-205, 224. 

^ '‘Theodore Clymer, “Some Current Needs in Educational Research,” Phi Delta Kapp , 
XL, No. 6 (1959), 253-257. 
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Succcstions for rc'^carcli have also been piiblislied in specific areas of the 
curriculum. Gray.’’ for example, has suggested a number of possible studies 
concerned with the improvement of reading. These include analysis of those 
aspects of intelligence most responsible for learning to read, determination 
of limits in both reading speed and comprehension for students of various 
levels of ability, determination of the optimum methods for learning to read, 
dilTcrcnccs in reading approaches for boys and girls, investigation of those 
emotional factors that retard reading instruction, and various methods of 
analyiting the organisational structure of reading to provide for individual 
differences. 

In science education, \Vat<ion and Coolex’’’ have indicated that research is 
needed to better understand the learning process, the learner, and the teacher. 
More specifically, they argue that research is needed to understand “the con- 
ceptual processes by which young children form categories" and to develop 
new methods of measuring achievement in .science. 

Suggestions for Rcscjircti in Other .Areas of Rdiicntion 

It is not possible here to examine all of the suggestions for the selection of 
research topics. .All we have attempted to do is to sample some of the sug- 
gestions made by specialists in the hope that the student will gain some 
insight into the type of research which is most needed in education. Students 
interested in suggestions related to administrative research, for example, 
should see Roesch,'" Stein.'- and Cocking.''-’ In research related to teacher 
education, the AACTI; Study Series. Needed Research in Teacher Education, 
should prove to be of value to interested students. In elementary education, 
Hendrickson,-' Smith,"- and LaBrant, Marcus, and Steinberg-^ provide 
students with possible projects. Students interested in secondary education 
will find the article by Angelino"' of some interest. 

"'William S. Gray, "Needed Research in Reading," Elcnw/iiarv English, XXXIX, No. 2 
(1952), 100-108. 

"’Fletcher G. Watson and William W. Cooley, “Needed Research in Science Education," 
in Rethinking Science Education, 59th NSSE Yearbook, Part 1, (Chicago: University of 
Chicago Press, 1960), pp. 297-312. 

"Winston Roesch, “Selected Areas for Research in School District Reorganization," 
Phi Delta Kappan, XL, No. 8 (1959), 328-330. 

'®Harry L. Stein, “Needs and Dimensions of Research," Phi Delta Kappan, XXXVII, 
No. 7 (1956) 316-327. 

'“Walter Cocking, “Need for School Plan Research," School Executive, LXXVI, No. 1 
(1956), 7. 

“Joint Committee of the American Association of Colleges for Teacher Education and 
the American Educational Research Association, Needed Research in Teacher Education, 
(Oneonta, N. Y.: American Association of Colleges for Teacher Education, 1954). 

“'Gordon Hendrickson, “Some Needed Research in Elementary Education,” The 
Elementary SchoolJournal, LI, No. 3 (1950), 127-135. 

““Nila Banton Smith, “Areas of Research Interest in the Language Arts,” Elementary 
English, XXXIX, No. 1 (1952), 31-34, 50. 

“^Lou LaBrant, Fred Marcus, and Erwin R. Steinberg, “Needed Research in Language 
Expression,” Elementary English, XXIX, No. 1 (1952), 35-38. 

“‘Henry R. Angelino, “Needed Research,” Review of Educational Research, XXX, 
No. 1 (1960), 86-88. 
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DELIMITING AND SPECIFYING THE 
PROBLEM 

So r.'ir in (his cliaptcr \vc have described a number of criteria for selecting 
a research problem and have indicated that tiicrc are various sources for 
locating pubiisiicd research ideas. Many students, however, have no idea of 
any research topic winch embraces their own interests and abilities, and which 
at the same time has (he potential of becoming a useful contribution to educa- 
tional theory or practice, in this section we will suggest more specific ways 
for (he student to find a subject worthy of investigation. 

Traditionally, empirical studies of education have been divided into a 
number of categories, such as educational psychology, elementary and sec- 
ondary curriculum and methods, and educational administration. Each 
division, although not entirely independent, is sufficiently homogeneous in 
content and method so that the student will sooner or later have to commit 
himself primarily to one of them. Each of the major fields of interest can be 
further analyzed into various specializations such as the following; 


Educational 

Psychology 

Elementary and 
Secondary Education 

Educational 

Administration 

learning theory 

objectives of the school 

federal, state, and local 
aspects of administration 

measurement 

organization of classes 

school boards 

exceptional children 

curriculum planning 

school law 

counseling and 
guidance 

role of the teacher 

finance 

growth and 

relation of school to com- 

construction and mainte- 

development 

munity 

nance 

personality and 
character 

specific areas of the cur- 
riculum 

teaching methods 

business management 

transportation facilities 
organization of schools 
pupil and teacher adminis- 
tration 


Let us suppose that the student has selected educational psychology as 
his major field of interest and that measurement is his specialty. Here again, 
a further analysis can be made; 

Major field of interest Educational Psychology 

Specialty Measurement 

Possible areas of concentration I. Construction of teacher-made ex- 

aminations 

2. Statistical analyses of tests and test 
results 
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The Harris, ed., Eiwyclopaiiia of Educational Research 3rd ed., (New York: 

Macmillan Company, Publishers, I960). 
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one of the first sources researchers should examine as they attempt to build 
up a review of the literature. 

Another excellent source that should be consulted is the Review of Edu- 
cational Research, which is published by the same organization that publishes 
the Encyclopedia of Educational Research (the American Educational 
Research Association). The Review attempts to survey the major research 
findings in the more active research areas of education every three years. 
Less active areas of research are covered every six years. It thus provides 
much of the same type of information provided by the Encyclopedia of 
Educational Research, but does not attempt to be cumulative. The Review 
covered educational and psychological testing in February, 1 959, in February, 
1962, and again in February, 1965. 

Suppose, however, that the student wants even more up-to-date infor- 
mation than the last issue of the Review can provide. At this point he should 
consult the Education Index. Published ten times annually, the Index provides 
the most recently published articles in journals, books, yearbooks, and 
bulletins concerned with education. After July 1, 1961, personal author 
entries were eliminated in the Index, so the student now has to look up 
articles by topic and subject rather than by author. 

It is not possible to indicate here all of the journals which may be of use to 
students in education who are trying to select research problems. Most 
universities have research librarians who specialize in helping students find 
the sources they need, and the student should take advantage of their services. 
In addition, Alexander and Burke” have published an excellent guide for the 
location of educational information and data. It provides a simple but rather 
complete analysis of the types of practical problems which researchers are 
bound to come across and supplies useful methods of gathering the needed 
information. 

An example of how a research topic may be selected will be useful at this 
point. Suppose that the student has read the various references in the Encyclo- 
pedia of Educational Research concerning the meaning and measurement of 
intelligence. He understands various theoretical viewpoints concerning 
the concept. In addition, he may become familiar with much of the terminol- 
ogy needed to comprehend studies involving intelligence, such as mental age, 
individual tests, and PA norms. Then, by using the appropriate edition of the 
Review of Education Research, in this case “Educational and Psychological 
Testing,” the student can delimit his area of investigation. For example, the 
1962 Review made the following suggestions for needed research : 

Studies assessing the effect of long-term changes in individuals — the 

stability problem — have been less common [than studies assessing short- 
term fluctuations in test performance] .... 

-'Carter Alexander and Arvid J. Burke, How to Locate Educational Information and 
Z)ato(4th Ed.) (New York: Bureau of Publications, Teachers College, Columbia University, 
1958). 
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Follow-up studies with the Wcchsler tests have been rare. Dunean and 
Barrett (1961) reported a correlation of .82 over a 10-year period for a 
group of superior adults, but they used only 28 cases. 

Studies relating test performance to various aspects of learning con- 
tinued to be plagued with the problem of adequate measures of learning. 
This research area desenes the increasing attention it has been getting. 

It is not known whether children whose performance scores are con- 
siderably higher than tlicir verbal scores profit more from remedial or 
therapeutic experience than children with comparable verbal scores whose 
performance scores are not deviant. 

The Davis-Ecls Games^ constructed especially to provide a “fairer” meas- 
ure for low socio-economic groups, was found to correlate negligibly with 
social status in a study by Noll (1960); but in another study by Knief and 
Stroud (1959), which was consistent with most previous findings, the Davis- 
Ecls Gar7ics discriminated according to social class about as much as other 
tests.-® 

Each of these points could very well provide the student with a research 
topic in educational measurement. The scope of each has been delimited by 
making specific recommendations for possible research studies. 


SUMMARY 

1 . Four criteria for the selection of a research project were described : 

a. Interest. In its extreme form the criterion of interest assumes that all 
activities develop from the researcher’s personal preferences. This point 
of view denies the public nature of science, which demands that research 
activities be the property of all concerned individuals. The researcher has 
an obligation to select problems which not only concern himself but which 
also have some probability of concerning other members of the scientific 
community. 

b. Economics. The economic criterion for the selection of a research 
problem reminds the investigator that some proposed projects may not be 
feasible because of the expenses involved. It by no means states that expense 
should be the only criterion for assessing the value of a study. 

c. Ability and training. Students should consider their own training before 
they commit themselves to a particular investigation. Both assets and lia- 
bilities should be examined as honestly as possible. The amount of time 
needed to gain competency in a given area should also be considered. 

d. Uniqueness. Although no investigation can be entirely novel or unique, 
students should attempt to select projects which have the potential of 
adding new information to education. The criterion of uniqueness does not 
imply that studies cannot be redone to increase the extent to which their 
findings can be generalized, 

2. The relationship between theory and the selection of a research problem 
was discussed. Empirical investigations can contribute to a better understand- 

^®Norman E. Wallen, “Development and Application of Tests of General Mental Ability,” 
Review of Educational Research, XXXII, No. 1 (1962), 15-24. 



84 


Selecting a Research Problem 


ing of a theory by clarifying, delimiting, and defining it; in addition, the 
consequences implied by a theory can be empirically investigated to help 
validate the theory. 

3. Three types of research topics were described which could be useful in 
correcting methodological problems: 

a. Research topics may be selected to clarify apparently contradictory 
findings by other researchers. 

b. Many commonly accepted research findings are based upon faulty 
methodology. Students may find possible topics for research by redesigning 
such studies. 

c. Students may find valuable sources for possible research by examining 
the statistical analyses performed by other investigators and re-analyzing 
poorly treated data. 

4. Research that is designed to investigate a narrow problem which is not 
related to theory has limited value, not only for the profession as a whole 
but also for the investigator himself. Such studies may yield knowledge which 
is of immediate consequence, but unless the study can be generalized to other 
persons, places, or events, its conclusions must of necessity be overly 
restricted. 

5. Students may find published lists of possible research topics to be of 
value to them in choosing adequate problems for investigation. Examples of 
published suggestions were provided for research on measurement, gifted 
children, and various aspects of the curriculum. 

6. The suggestion was made that the student attempting to select a research 
problem should first decide upon his major field of interest (e.g., educational 
psychology, elementary or secondary education, administration). Within 
this major field of interest, he can next select a “specialty,” such as counseling 
and guidance, teaching of reading, or school finance. The specialty can then 
be further analyzed into possible areas of concentration. 

A specific research topic can be selected, refined, and delimited to reason- 
able size and scope by examining the literature pertaining to a given “area of 
concentration.” It was suggested that the use of the Encyclopedia of Educa- 
tional Research would provide the student with a broad overview of a 
particular field of investigation and would also provide a useful beginning 
bibliography. The Review of Educational Research and the Education Index 
were also suggested as very useful sources for gathering information. 


PRACTICE EXERCISES 


1 . Select any single issue from one of the following sources : 
Journal of Educational Psychology 
Educational Leadership 
School Review 

The Elementary School Journal 
Journal of Experimental Education 
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a. Examine carefully each empirical article in the i-i-^ue you have ‘^clrctcd 
and indicate how each can he iuvtificd. \\’hich of the article^ \ou luuc 
reviewed arc most likely to make a valuable contribution to education? 
^^^^y? Justify your position. 

b. \\niat criteria did the authors of the article^ >ou have '^elected u^e m 
determining their topics to investigate? 

2. Examine one issue of each of the following journaU: 

Review o f Educational Research 
Journal of Experimental Education 
Educational and Psychological Measurement 
What types of research (analytic, descriptive, or experimental) doe-; each 
journal contain ? 

3. Examine two or three journals in your own field of speciali/ation. What 
arc the current problems being investigated in your area? What theoretical 
positions arc you aware of in your specially? \N‘hal lype> of applied problems 
are being studied in your field? 

4. For each of the following fictitious titles of proposed studies, indicate 
whether or not you would be willing to have a master’s degree candidate 
submit the title if you were chairman of his thesis committee. Justify your 
decisions. Indicate what additional information you might want. What 
improvements, if any, would you suggest? 

a. A Description of the Guidance Program at EImville High .School 

b. Attitudes of High School Students Toward EImville High School 

c. A Follow-up of Students Graduating from EImville High School 

d. The Role of the Principal in EImville High School 

e. The Role of the Coordinator of Extracurricular Activities in California 

f. A Technique for Using the Chalk Board More EITcctively 

g. The School Lunch Line; A Proposed Method for Increasing Its 
Efficiency 

h. The Attitudes of School Board Members to Ability Grouping 

i. The Effect of Monetary Rewards in Increasing Motivation 


SELECTED RELATED READINGS 


1. Bachrach, Arthur J., Psychological Research: An Introduction. New 
York: Random House, Inc., 1962, 113 pages. Chapter 1 (pp. 3-25) is a 
delightfully written account of how accidental discovery rather than 
active search has led to the most useful research problems. The student 
should keep in mind, however, that the scientists were actively engaged 
in searching for the answer to a specific problem when they accidentally 
came upon the solution to an even more important one. 

2. Findley, Warren G., “The Impact of Applied Problems on Educational 
Research,” in First Annual Phi Delta Kappa Symposium on Educational 
Research. Bloomington, III.: Phi Delta Kappa, Inc., 1960, pp. 43-53. 
A thoughtful consideration of how applied or “practical” problems 
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affect educational research. The author defends the notion that research 
findings must be applied to and evaluated in local classrooms before 
they can be generally accepted. In defending his point of view, Findley 
describes some of the requirements for performing practical research 
(see especially pp. 49-53). The student should also examine pp. 96-112 
for a critical discussion of Findley’s viewpoint. 

3. Rummel, J. Francis, An huroduction to Research Procedures in Education. 
New York; Harper & Row, Publishers, 1958, 413 pages. See especially 
pp. 20-39. Rummel discriminates clearly between subjects suitable for 
term papers, field studies, theses, and dissertations. In addition, the 
criteria of interest, significance, ability, and availability of data are 
discussed. 

4. Van Dalen, Deobold B., Understanding Educational Research, 2nd Ed., 
New York: McGraw-Hill Book Company, 1966, 525 pages. See especially 
pp. 119-144. A general introduction to the analysis of a problem. 
Especially valuable are the author’s examples of how problems may be 
analyzed and evaluated. 



CHAPTER FOUR 


Reviewing; the Literature 

o 


Selecting a research problem requires that students have some familiarity with 
what previous investigations have found. Many thesis chairmen have had 
the experience of graduate students selecting research problems which reflect 
a serious lack of understanding of what other investigators have done. This 
lack of understanding may exhibit itself in a number of ways. The student may 
be unable to justify the need for a proposed investigation. He may select 
a particular hypothesis to test which has already been confirmed or dis- 
confirmed. Or he may use techniques which previous research has invalidated 
for his particular purpose. In any of these instances, a review of the literature 
might have pointed out the need for specific studies and suggested those 
techniques which might be most useful for some given problem. 

When the student has an idea for a research project, the review of the 
literature helps him select a problem, delimit its size and scope, show its 
relationship to previously completed research, and examine tools and methods 
which may be of value in designing his study. With this information, the 
student is in a position to evaluate for himself the efficacy of his plans and 
the importance of his investigation. Without it, he may find himself wasting 
much time and effort. 

Understanding the Relationship of the Proposed Topic 

to Previously Completed Studies 

One major advantage of a review of the literature is that it organizes a 
proposed field of investigation and indicates the ways in which the proposed 
study is related to previous research. A well-organized review shows 
the relationship of various studies to each other and thus forms the initial 
groundwork for the development of theory. In addition, by describing the 
relationships that his proposed investigation has to completed studies, the 
educational researcher has the opportunity to demonstrate the possible con- 
tributions his investigation can make to a body of accumulated knowledge. 
Without a review of the pertinent literature, it would be quite difficult t( 
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assess the potentiality of a given research proposal. In addition, of course, 
many problems have roots in diverse fields both within and outside of 
education; the investigator has the responsibility of indicating the connec- 
tions — tenuous though they may be — between his studies and previously 
completed ones. 

Analysis of Useful Methodology 

The review of the literature helps the student to find research techniques 
that are useful in his own particular area of investigation. Almost all pub- 
lished studies describe methods and techniques used to gather information. 
By examining these studies in detail the student can provide himself with 
knowledge of how other investigators attacked problems similar to those 
which he may face. 

Suppose, for example, that an investigator is interested in studying how 
prejudice develops among children. At what ages do children begin making 
differential responses favoring one racial group over another? Does prejudice 
develop in the same manner for members of minority groups as it does for 
members who are in the majority? The most apparent method of answering 
these questions might be to follow a group of Negro and Caucasian children 
throughout their childhood years. By observing their responses to members 
of other races, the researcher would have some idea when prejudice was 
beginning. The difficulty with that approach, of course, is the amount of 
time it would take. 

In reviewing the literature on the development of prejudice, the student is 
likely to come across a study by the Clarks,’ which employed dolls that were 
identical except for color. By asking Negro children questions about the dolls, 
the experimenters were able to gather information concerning preferences, 
knowledge of racial differences, and extent to which the children identified 
with members of their own racial group. This particular technique might also 
prove to be of value in other studies involving the genesis of prejudice, ego 
involvement, authoritarianism, or stereotypes. 


WRITING THE REVIEW OF THE LITERATURE 

Students often consider the writing of a review of the literature as an 
unnecessary requirement designed by their professors to make them prove 
that the proposed research is an original contribution. Having this belief, 
the student begins his review with something less than the zeal which the 
task demands. 


'Kenneth B. Clark and Mamie P. Clark, “Racial Identification and Preference in Negro 
Children,” in Readings in Social Psychology, ed. Eleanor E. Maccoby, Theodore M. New- 
comb, and Eugene L. Hartley (3rd ed.), (New York: Holt, Rinehart & Winston, Inc., 1958), 

pp. 602-611. 
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The review of the literature is not designed to prove tire originality of a 
research design or topic. A review which attempts to prove that no other 
person has considered a particular study before is wasteful and unnecessary. 
Far from showing uniqueness, the review of the literature primarily should 
show how the proposed study is related to other investigations. In addition, 
it should, of course, show the contribution to a particular field that the pro- 
posed research will make. 

A second misconception concerning the review of the literature is that it 
forces the investigator to examine every study which is at all related to his 
proposed research. The student may thus consider the review as an attempt 
by his professors to compel him to be scholarly and complete. There are two 
major arguments which may be raised against an exhaustive review of the 
literature. The first is that it would be impossible. Literally hundreds of 
studies exist on any given topic. To be forced to read each would require 
a lifetime of devotion Just to write the review of the literature. Considering 
the interrelatedness of investigations, an exhaustive search on any one topic 
would no doubt turn up far more studies than one would possibly need to 
Justify a proposed research and to show its relationship to other investigations. 
This point is related to the second argument against an exhaustive search. 
Even if it were possible to examine every study related to a given topic, it 
would still be unnecessary to do so. The purpose of the review is to show how 
the proposed research is related to previous investigations and how it can 
make a unique contribution. These objectives do not require that all possible 
sources be included in the review. They do mean that the review imtst be 
selective rather than exhaustive and organized rather than a list of published 
investigations, and that it should show the relationship of the proposed study 
to other studies. 

Selection of Studies to Be Included 
in the Review of the Literature 

Making the review of the literature selective rather than exhaustive requires 
that the student be discriminating in his choice of articles and books to be 
included in the review. The suggestions which follow are designed to help 
the student select the most relevant sources of information. 

a. Many more references can be included in the review of the literature in a 
thesis or dissertation than can be reported if the research is to be published 
in a Journal. Journal space is usually quite limited, making it necessary to 
include only the most relevant information. In addition. Journals are 
usually designed to be read by specialists, who presumably are familiar 
with previous research studies; therefore, the review can be curtailed. 
In master’s theses and doctoral dissertations, however, the paper is usually 
addressed to the intelligent layman who has had limited training in the 
particular field of investigation. 

b. Of two similar and equally valuable articles on the same subject, select 
the more recent for detailed analysis. The older article may be referred to 
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by staling: “Similar results were found by Jones (1927).” In this way, the 
review is kept as up-to-date as possible, but credit is still given to earlier 
relevant works. 

c. Some indication should be made why each reference in the review of the 
literature was included. The review may include some references to articles 
because of their historical interest. Thus, the reviewer might state: 
“Although Pavlov (10) appears to have been the first investigator to 
employ the differential effect of partial versus continuous reinforcement, 
it was Skinner (12, 46) who recognized the theoretical and practical 
importance of Pavlov’s discoveries.” 

d. Some articles might be included in the review because the writer wishes 
to discriminate between various theoretical positions or between findings 
that are ostensibly contradictory. Where this is the case, the writer can 
describe the major points of view for each position, and then simply 
provide a reference to the advocates of each. Thus the review of the 
literature might state, “Whereas Skinner ( 1 958) has advocated the required 
use of many small steps in the development of material suitable for 
programmed instruction, Crowder (I960) has suggested that some stu- 
dents may skip materials which are simple for them. In partial support of 
Skinner’s contention, Coulson and Silberman (1960) found that the use 
of small steps led to significantly higher scores on examinations than did 
the use of larger steps.” 

e. Where there is some disagreement in opinion or methodology in the 
published literature, the student can select articles for inclusion in his 
review which seem to be representative of various points of view or which 
have used different techniques. 

Organization of the Review of the Literature 

The review of the literature should never be a simple listing of various 
studies which are vaguely related to the proposed topic for investigation. 
Each review should be organized; this organization should be made explicit 
by dividing the review into major and minor headings. 

In organizing the review, one must adhere to the logical principles of 
division. These principles require that the student develop a system in much 
the same way that he would develop an outline, by beginning with major 
headings (usually given Roman numerals I, II, III, IV, etc.) and subdividing 
each major heading into subparts (A, B, C, D). If further subdivisions are 
necessary, they may be given lower-case Arabic numerals (1,2, 3, 4), and these 
may be further divided) by using lower-case letters (a, b, c, d). For example, 
the concept of measurement could be partially outlined as follows: 

Measurement 

I. Psychological Measurement 
A. Types 

1. Intelligence 

a. individually administered tests 

b. group tests 
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2. Aptitude 

3. Personality 

a. projective techniques 

(1) Thematic Apperception Test 

(2) Rorschach 

b. pencil-and-paper tests 

B. History 

IT. Physical Measurement 

A. Weight 

B. Height 

C. Distance 

The principle of exhaustiveness requires that the outline be complete. 
For example, points I and II should be the only types of measurement 
possible. Similarly. I A and IB should contain all possible knowledge con- 
cerning psychological measurement, and points 1. 2. and 3 would have to 
include all types of tests. By not including attitude scales under section lA, 
the fallacy of incomplete division is committed. 

The principle of exclusiveness requires that categories within headings 
do not overlap each other. Thus, dividing types of schools into preschools 
(ages 5 and 6), elementary schools (grades 1-6), junior high schools (grades 
7-9), and high schools (grades 10-12) would violate this principle, because 
some children who are 6 years of age might be in the first grade. These chil- 
dren would, therefore, have more than one classification which refers speci- 
fically to them. 

The principle of single classification requires that all items included at a 
given level be selected on the same basis. For example, in the outline given 
above, physical measurement was subdivided according to a single type of 
classification, object of measurement. If subtopic D had been “Pounds,” 
then the fallacy of cross division would have been committed. The use of 
“Pounds” would change the topics under physical Measurement to include 
two bases for selection: object of measurement and unit of measurement. 
Similarly, the classification of schools into levels is perfectly legitimate as 
long as a fourth level such as “vocational education” is not added. 

The reader of the review of the literature deserves to be told the basis upon 
which it is being organized. This is most simply accomplished by providing 
the reader with an introductory paragraph or two describing how the review 
is organized. For example, in one study- which compared physics students 
of various levels of abilities who were taught by traditional methods with 
students taught by the use of a television film, the dissertation writer began 
his review of the literature in the following way: 


^Leonard James Garside, “A Comparison of the Effectiveness of Two Methods of 
Instruction in High School Physics as Measured by Levels of Achievement of Students of 
High and Low Intelligence,” (Doctoral Dissertation, University of Wisconsin, 1959). 



